Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

83

Full-text search

Active filters: ollama

pacozaa/mistral-sharegpt90k

Updated Aug 2, 2024 • 1

pacozaa/mistral-sharegpt90k-merged_16bit

Text Generation • Updated Jul 30, 2024 • 14

TrabEsrever/dolphin-2.9-llama3-70b-GGUF

Updated Apr 29, 2024

daekeun-ml/Phi-3-medium-4k-instruct-ko-poc-gguf-v0.1

Text Generation • Updated May 26, 2024 • 11 • 1

hierholzer/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Dec 11, 2024 • 98 • 3

LucasInsight/Meta-Llama-3-8B-Instruct

Updated Aug 20, 2024 • 19

Shyamnath/Llama-3.2-3b-Uncensored-GGUF

Text Generation • Updated Oct 21, 2024 • 87 • 3

cahaj/Phi-3.5-mini-instruct-text2sql-GGUF

Updated Aug 29, 2024 • 22

Agnuxo/Tinytron-Qwen-0.5B-Instruct_CODE_Python_Spanish_English_16bit

Updated Sep 2, 2024

Agnuxo/Tinytron-Qwen-0.5B-TinyLlama-Instruct_CODE_Python-extra_small_quantization_GGUF_3bit

Updated Sep 2, 2024

Agnuxo/Tinytron-Qwen-0.5B-Instruct_CODE_Python-Spanish_English_GGUF_4bit

Updated Sep 2, 2024

Agnuxo/Tinytron-Qwen-0.5B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_q5_k

Updated Sep 2, 2024

Agnuxo/Tinytron-Qwen-0.5B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_q6_k

Updated Sep 2, 2024

Agnuxo/Tinytron-Qwen-0.5B-Instruct_CODE_Python-GGUF_Spanish_English_8bit

Updated Sep 2, 2024

Agnuxo/Tinytron-Qwen-0.5B-Instruct_CODE_Python_English_GGUF_16bit

Updated Sep 2, 2024 • 1

Agnuxo/Tinytron-Qwen-0.5B-TinyLlama-Instruct_CODE_Python-Spanish_English_GGUF_32bit

Updated Sep 2, 2024

129developer/test

Text Generation • Updated Oct 19, 2024

prithivMLmods/Llama-3.2-1B-GGUF

Text Generation • Updated Nov 20, 2024 • 305 • 7

GiKAGraphy/ProductLlama_V5

Text Generation • Updated Nov 7, 2024

prithivMLmods/Llama-SmolTalk-3.2-1B-Instruct

Text Generation • Updated 29 days ago • 735 • 8

mradermacher/Llama-SmolTalk-3.2-1B-Instruct-GGUF

Updated Nov 25, 2024 • 189 • 1

mradermacher/Llama-SmolTalk-3.2-1B-Instruct-i1-GGUF

Updated Nov 25, 2024 • 302

QuantFactory/Llama-SmolTalk-3.2-1B-Instruct-GGUF

Text Generation • Updated Nov 25, 2024 • 155 • 2

bartowski/Llama-SmolTalk-3.2-1B-Instruct-GGUF

Text Generation • Updated Nov 26, 2024 • 161 • 1

Supa-AI/malaysian-Llama-3.2-3B-Instruct-gguf

Updated Nov 27, 2024 • 37

mradermacher/SmolLM2-Math-IIO-1.7B-Instruct-GGUF

Updated Dec 4, 2024 • 37

Supa-AI/llama-7b-hf-32768-fpf-gguf

Updated Dec 10, 2024 • 34

mradermacher/Codepy-Deepthink-3B-GGUF

Updated 16 days ago • 359

mradermacher/Codepy-Deepthink-3B-i1-GGUF

Updated 16 days ago • 550

itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 15 days ago • 8