Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

5,478

Full-text search

Active filters: pt

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-2.5bit

Text Generation • Updated Aug 20, 2024 • 4

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-2.2bit

Text Generation • Updated Aug 20, 2024 • 5

mradermacher/Llama-3.1-Storm-8B-i1-GGUF

Updated Aug 20, 2024 • 75 • 3

mradermacher/magnum-v2-123b-i1-GGUF

Updated Sep 8, 2024 • 10 • 6

hamalshe/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 20, 2024

drexample/magnum-v2-123b-exl2-6.0bpw

Text Generation • Updated Aug 20, 2024 • 4

legraphista/Llama-3.1-Storm-8B-IMat-GGUF

Text Generation • Updated Aug 20, 2024 • 212

Epiculous/Azure_Dusk-v0.1-Exl2

Text Generation • Updated Aug 24, 2024 • 1

Trac9/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 20, 2024 • 1

Epiculous/Azure_Dusk-v0.1-GGUF

Text Generation • Updated Aug 24, 2024 • 49 • 4

Nekuromento/ghost-8b-beta-1608-Q5_K_M-GGUF

Text Generation • Updated Aug 20, 2024 • 4

Nekuromento/ghost-8b-beta-1608-Q4_K_M-GGUF

Text Generation • Updated Aug 20, 2024 • 2

WallStarer/magnum-v2-123b_Exl2_3.5bpw

Text Generation • Updated Aug 21, 2024 • 6

Nekuromento/ghost-8b-beta-1608-Q6_K-GGUF

Text Generation • Updated Aug 20, 2024 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_2.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 5 • 1

drexample/magnum-v2-123b-exl2-5.0bpw

Text Generation • Updated Aug 21, 2024 • 4 • 1

QuantFactory/magnum-v2.5-12b-kto-GGUF

Text Generation • Updated Aug 21, 2024 • 19 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_3.0bpw_h6

Text Generation • Updated Aug 21, 2024 • 7 • 1

WallStarer/magnum-v2-123b_Exl2_4.25bpw

Text Generation • Updated Aug 21, 2024 • 2

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_3.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 6 • 1

drexample/magnum-v2-123b-exl2-5.6bpw

Text Generation • Updated Aug 21, 2024 • 7

jburmeister/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 21, 2024 • 4

ravs1980/jordan_Llama3_8b_pt_br

Text Generation • Updated Aug 26, 2024 • 7

NikolayKozloff/ghost-8b-beta-1608-Q8_0-GGUF

Text Generation • Updated Aug 21, 2024 • 6 • 1

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.0bpw_h6

Text Generation • Updated Aug 21, 2024 • 6

WallStarer/magnum-v2-123b_Exl2_3.75bpw

Text Generation • Updated Aug 21, 2024 • 2

dsouza889/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 21, 2024

mradermacher/magnum-v2-72b-GGUF

Updated Sep 8, 2024 • 67 • 1

ddh0/Mistral-Large-Instruct-2407-q8_0-q8_0-GGUF

Updated Aug 22, 2024 • 4

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_4.5bpw_h6

Text Generation • Updated Aug 21, 2024 • 4 • 1