Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,953

Full-text search

Active filters: facebook

LoneStriker/Llama-3.3-70B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 35 • 2

LoneStriker/Llama-3.3-70B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 50 • 1

LoneStriker/Llama-3.3-70B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 17 • 3

LoneStriker/Llama-3.3-70B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Dec 6, 2024 • 13 • 3

LoneStriker/Llama-3.3-70B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 25 • 2

MikeRoz/meta-llama_Llama-3.3-70B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Dec 7, 2024 • 52 • 1

LoneStriker/Llama-3.3-70B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Dec 7, 2024 • 42 • 1

mradermacher/Llama-3.3-70B-Instruct-GGUF

Updated Dec 16, 2024 • 142 • 3

second-state/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 283

gaianet/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 271

mradermacher/Llama-3.3-70B-Instruct-i1-GGUF

Updated Dec 8, 2024 • 4.07k • 4

tensorblock/Llama-3.3-70B-Instruct-GGUF

Updated Dec 7, 2024 • 2.41k • 9

osllmai-community/Llama-3.3-70B-Instruct-GGUF

Updated 2 days ago • 21

tensorblock/llama3-instruct-8b-GGUF

Text Generation • Updated Dec 7, 2024 • 3

Dracones/Llama-3.3-70B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 7, 2024 • 7

Dracones/Llama-3.3-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 7, 2024 • 4

Dracones/Llama-3.3-70B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 7, 2024 • 15

yejingfu/Llama-3.3-70B-Instruct

Text Generation • Updated Dec 7, 2024 • 13

bartowski/Llama-3.3-70B-Instruct-exl2

Text Generation • Updated Dec 20, 2024 • 97 • 3

Dracones/Llama-3.3-70B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 7, 2024 • 15 • 1

Dracones/Llama-3.3-70B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 7, 2024 • 26 • 2

Dracones/Llama-3.3-70B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 7, 2024 • 19

Dracones/Llama-3.3-70B-Instruct_exl2_3.5bpw

Text Generation • Updated Dec 7, 2024 • 5

ThomasBaruzier/Llama-3.3-70B-Instruct-GGUF

Updated Dec 15, 2024 • 4.96k • 1

Jacoby746/Llama-3.3-70B-Instruct-exl2-5.0bpw

Text Generation • Updated Dec 7, 2024 • 6

Dracones/Llama-3.3-70B-Instruct_exl2_3.0bpw

Text Generation • Updated Dec 7, 2024 • 8

Dracones/Llama-3.3-70B-Instruct_exl2_2.5bpw

Text Generation • Updated Dec 7, 2024 • 10

Dracones/Llama-3.3-70B-Instruct_exl2_2.25bpw

Text Generation • Updated Dec 7, 2024 • 7

Dracones/Llama-3.3-70B-Instruct_exl2_2.75bpw

Updated Dec 7, 2024

mradermacher/Meta-Llama-3-MoE-4x8B-Instruct-GGUF

Updated Dec 8, 2024 • 186