Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,948

Full-text search

Active filters: facebook

bullerwins/Llama-3.3-70B-Instruct-exl2_6.0bpw

Text Generation • Updated Dec 8, 2024 • 17

bullerwins/Llama-3.3-70B-Instruct-exl2_8.0bpw

Text Generation • Updated Dec 8, 2024 • 8

tensorblock/calme-2.3-llama3-70b-GGUF

Text Generation • Updated Dec 9, 2024 • 41

SYNERDATA/SYNERDATA-Meta-LLaMA-3.1-8b-Instruct-128k-Q8_0.GGUF

Text Generation • Updated Dec 9, 2024 • 8

bullerwins/Llama-3.3-70B-Instruct-exl2_3.0bpw

Text Generation • Updated Dec 9, 2024 • 5

bullerwins/Llama-3.3-70B-Instruct-exl2_4.5bpw

Text Generation • Updated Dec 9, 2024 • 17

bullerwins/Llama-3.3-70B-Instruct-exl2_5.5bpw

Text Generation • Updated Dec 9, 2024 • 6

bullerwins/Llama-3.3-70B-Instruct-exl2_6.5bpw

Text Generation • Updated Dec 9, 2024 • 4

bullerwins/Llama-3.3-70B-Instruct-exl2_3.5bpw

Text Generation • Updated Dec 9, 2024 • 8

tensorblock/Llama-3-8B-Instruct-DPO-v0.3-GGUF

Text Generation • Updated Dec 9, 2024 • 80

tensorblock/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Dec 12, 2024 • 123

Infermatic/Llama-3.3-70B-Instruct-FP8-Dynamic

Text Generation • Updated Dec 9, 2024 • 4.47k

tensorblock/calme-2.4-llama3-70b-GGUF

Text Generation • Updated Dec 10, 2024 • 110

MoreWrong/study_budyMerged

Text Generation • Updated Dec 10, 2024 • 10

amd/Llama-3.1-8B-awq-g128-int4-asym-fp16-onnx-hybrid

Text Generation • Updated Dec 13, 2024 • 17

mradermacher/Llama-3-13B-Instruct-v0.1-GGUF

Updated Dec 11, 2024 • 108

mradermacher/Llama-3-16B-Instruct-v0.1-GGUF

Updated Dec 11, 2024 • 79

mradermacher/Llama-3-16B-Instruct-v0.1-i1-GGUF

Updated Dec 11, 2024 • 41

fierysurf/Llama-Guard-3-1B-AWQ

Text Generation • Updated Dec 11, 2024 • 7

mradermacher/Llama-3-13B-Instruct-v0.1-i1-GGUF

Updated Dec 11, 2024 • 263

piyaldey/Llama-3.2-1B-cv-job-description-matching

Text Generation • Updated Dec 11, 2024 • 119

mradermacher/Llama-3-16B-GGUF

Updated Dec 11, 2024 • 33

mradermacher/Llama-3-16B-i1-GGUF

Updated Dec 11, 2024 • 28

rudrankriyam/Hermes-3-Llama-3.2-3B-4bit

Text Generation • Updated Dec 11, 2024 • 92 • 1

jaeyunha/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • Updated Dec 12, 2024 • 1

mradermacher/Llama-3-70B-Instruct-32k-v0.1-GGUF

Updated Dec 12, 2024 • 11

zarag0z/Llama-3.1-8B-Q8_0-GGUF

Text Generation • Updated Dec 12, 2024 • 3

marinarosell/Meta-Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • Updated 4 days ago • 114 • 1

mradermacher/Llama-3-70B-Instruct-32k-v0.1-i1-GGUF

Updated Dec 15, 2024 • 60

amd/Llama-3-8B-awq-g128-int4-asym-fp16-onnx-hybrid

Text Generation • Updated Dec 13, 2024 • 14