Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,153

Full-text search

Active filters: llama-3

Dracones/Llama-3.3-70B-Instruct_exl2_2.5bpw

Text Generation • Updated Dec 7, 2024 • 10

Dracones/Llama-3.3-70B-Instruct_exl2_2.25bpw

Text Generation • Updated Dec 7, 2024 • 9

Dracones/Llama-3.3-70B-Instruct_exl2_2.75bpw

Updated Dec 7, 2024

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-asym

Text Generation • Updated Dec 7, 2024 • 77

mradermacher/Meta-Llama-3-MoE-4x8B-Instruct-GGUF

Updated Dec 8, 2024 • 187

tensorblock/Llama-3-70B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Dec 8, 2024 • 11

KnutJaegersberg/Llama3-ChatQA-2-70B-4.65bpw-exl2

Text Generation • Updated Dec 8, 2024 • 4

fbaldassarri/meta-llama_Llama-3.1-8B-auto_awq-int4-gs128-asym

Text Generation • Updated Dec 8, 2024 • 7

tensorblock/Llama3-ChatQA-1.5-70B-GGUF

Text Generation • Updated Dec 8, 2024 • 22

bullerwins/Llama-3.3-70B-Instruct-exl2_4.0bpw

Text Generation • Updated Dec 8, 2024 • 8

bullerwins/Llama-3.3-70B-Instruct-exl2_5.0bpw

Text Generation • Updated Dec 8, 2024 • 10

bullerwins/Llama-3.3-70B-Instruct-exl2_6.0bpw

Text Generation • Updated Dec 8, 2024 • 17

bullerwins/Llama-3.3-70B-Instruct-exl2_8.0bpw

Text Generation • Updated Dec 8, 2024 • 8

tensorblock/calme-2.3-llama3-70b-GGUF

Text Generation • Updated Dec 9, 2024 • 41

SYNERDATA/SYNERDATA-Meta-LLaMA-3.1-8b-Instruct-128k-Q8_0.GGUF

Text Generation • Updated Dec 9, 2024 • 8

bullerwins/Llama-3.3-70B-Instruct-exl2_3.0bpw

Text Generation • Updated Dec 9, 2024 • 5

bullerwins/Llama-3.3-70B-Instruct-exl2_4.5bpw

Text Generation • Updated Dec 9, 2024 • 17

bullerwins/Llama-3.3-70B-Instruct-exl2_5.5bpw

Text Generation • Updated Dec 9, 2024 • 6

bullerwins/Llama-3.3-70B-Instruct-exl2_6.5bpw

Text Generation • Updated Dec 9, 2024 • 4

bullerwins/Llama-3.3-70B-Instruct-exl2_3.5bpw

Text Generation • Updated Dec 9, 2024 • 8

tensorblock/Llama-3-8B-Instruct-DPO-v0.3-GGUF

Text Generation • Updated Dec 9, 2024 • 80

fbaldassarri/meta-llama_Llama-3.1-8B-auto_awq-int4-gs128-sym

Text Generation • Updated Dec 9, 2024 • 77

tensorblock/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Dec 12, 2024 • 123

Infermatic/Llama-3.3-70B-Instruct-FP8-Dynamic

Text Generation • Updated Dec 9, 2024 • 4.47k

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

Text Generation • Updated Dec 9, 2024 • 92 • 1

tensorblock/openbuddy-llama3-70b-v21.2-32k-GGUF

Text Generation • Updated Dec 10, 2024 • 11

tensorblock/calme-2.4-llama3-70b-GGUF

Text Generation • Updated Dec 10, 2024 • 110

MoreWrong/study_budyMerged

Text Generation • Updated Dec 10, 2024 • 10

tensorblock/airoboros-dpo-70b-3.3-GGUF

Updated Dec 10, 2024 • 38

mradermacher/Llama3-OpenBioLLM-70B-i1-GGUF

Updated Dec 12, 2024 • 744