Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

4-bit precision

Carbon Emissions

8-bit precision

text-embeddings-inference

Models

12,583

Full-text search

Active filters: llama-cpp

dimcha/mxbai-embed-large-v1-Q4_K_M-GGUF

Feature Extraction • Updated Jul 8, 2024 • 8

bmi-labmedinfo/Igea-3B-v0.1-GGUF

Updated Jul 15, 2024

Cran-May/internlm2_5-7b-chat-IQ4_XS-GGUF

Text Generation • Updated Jul 8, 2024

carterprince/google-gemma-2-27b-it-ortho-Q4_K_S-GGUF

Updated Jul 8, 2024 • 9 • 1

mrmage/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 8, 2024 • 3 • 1

mrmage/Qwen2-0.5B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Jul 8, 2024 • 5

ZappY-AI/medllama3-v20-Q4_K_M-GGUF

Updated Jul 8, 2024

martintomov/gemma-2-27b-it-Q8_0-GGUF

Text Generation • Updated Jul 8, 2024 • 3

jorismathijssen/t5-base-Q4_K_M-GGUF

Translation • Updated Jul 8, 2024 • 54 • 1

faceradix/Daredevil-8B-abliterated-Q4_K_M-GGUF

Updated Jul 8, 2024 • 5

martintomov/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Jul 8, 2024

Nialixus/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 8, 2024 • 1

saejoon/SOLAR-10.7B-Instruct-v1.0-Q4_K_M-GGUF

Updated Jul 9, 2024 • 2

aifeifei798/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 9, 2024 • 1

NikolayKozloff/bella-2-8b-Q8_0-GGUF

Text Generation • Updated Jul 9, 2024 • 1 • 1

NikolayKozloff/Storm-7B-Q8_0-GGUF

Updated Jul 9, 2024 • 3 • 2

NikolayKozloff/Einstein-v7-Qwen2-7B-Q8_0-GGUF

Updated Jul 9, 2024 • 1 • 1

jeiku/qwen2-7b-magpie300k_filtered_epoch2-Q4_K_M-GGUF

Updated Jul 9, 2024

zhentaoyu/Llama-2-13b-chat-hf-Q4_0-GGUF

Text Generation • Updated Jul 9, 2024 • 13

yoeldcd/leniachat-qwen2-1.5B-v0-Q4_0-GGUF

Updated Jul 9, 2024 • 3

dspasyuk/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 9, 2024 • 7

dspasyuk/Meta-Llama-3-8B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jul 9, 2024 • 3

timmyd69/Lama2-7b-chat-hf-oslo-merged-model-Q2_K-GGUF

Updated Jul 9, 2024

fanrey/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 9, 2024 • 4

martintomov/falcon-7b-instruct-Q8_0-GGUF

Updated Jul 9, 2024

fernandovmacedo/portuguese-Phi3-Tom-Cat-128k-instruct-Q4_K_S-GGUF

Text Generation • Updated Jul 9, 2024

apoleo/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 9, 2024 • 1

NikolayKozloff/SeaLLM3-7B-Chat-Q8_0-GGUF

Updated Jul 9, 2024 • 1

NikolayKozloff/GreekLlama-1.1B-it-Q8_0-GGUF

Text Generation • Updated Jul 9, 2024 • 17 • 1

NikolayKozloff/GreekLlama-1.1B-base-Q8_0-GGUF

Updated Jul 9, 2024 • 10 • 1