Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
llama-cpp
Inference Endpoints
Merge
Eval Results
text-generation-inference
AutoTrain Compatible
Mixture of Experts
4-bit precision
Carbon Emissions
8-bit precision
custom_code
text-embeddings-inference
Apply filters
Models
12,625
Full-text search
Edit filters
Sort: Trending
Active filters:
llama-cpp
Clear all
NikolayKozloff/dictalm2-it-qa-fine-tune-Q8_0-GGUF
Text Generation
•
Updated
Jul 2, 2024
•
2
•
3
nalf3in/gemma-2-9b-Q4_K_M-GGUF
Text Generation
•
Updated
Jul 2, 2024
•
23
ironlanderl/phi-3-mini-4k-f16-Q5_K_M-GGUF
Updated
Jul 2, 2024
•
20
ironlanderl/Phi-3-mini-4k-instruct-Q5_K_M-GGUF
Text Generation
•
Updated
Jul 2, 2024
NikolayKozloff/L3-8B-Everything-COT-Q8_0-GGUF
Updated
Jul 2, 2024
•
1
•
2
Gustav0-Freind/gemma-2-27b-Q6_K-GGUF
Text Generation
•
Updated
Jul 2, 2024
•
11
larenspear/Yi-1.5-34B-Chat-Q8_0-GGUF
Updated
Jul 2, 2024
•
2
larenspear/Yi-1.5-34B-Chat-Q6_K-GGUF
Updated
Jul 2, 2024
•
2
Reithan/L3-8B-Everything-COT-Q6_K-GGUF
Updated
Jul 2, 2024
•
1
Goekdeniz-Guelmez/J.O.S.I.E.v4o-7b-stage1-beta3.2-gguf
Updated
Jul 5, 2024
•
2
•
1
yh-yao/Phi-3-mini-4k-instruct-Q3_K_M-GGUF
Text Generation
•
Updated
Jul 2, 2024
•
7
yh-yao/Phi-3-mini-4k-instruct-Q3_K_L-GGUF
Text Generation
•
Updated
Jul 2, 2024
yh-yao/Phi-3-mini-4k-instruct-Q3_K_S-GGUF
Text Generation
•
Updated
Jul 2, 2024
•
1
sosoai/Hansoldeco-Gemma-2-9b-v0.1-Q4_K_M-GGUF
Updated
Jul 2, 2024
•
1
yh-yao/Phi-3-mini-4k-instruct-Q4_0-GGUF
Text Generation
•
Updated
Jul 2, 2024
•
10
yh-yao/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
Jul 2, 2024
•
4
yh-yao/Phi-3-mini-4k-instruct-Q4_K_S-GGUF
Text Generation
•
Updated
Jul 2, 2024
•
1
•
1
sosoai/Hansoldeco-Gemma-2-9b-v0.1-Q6_K-GGUF
Updated
Jul 2, 2024
olileaf/Meta-Llama-3-8B-Q4_K_M-GGUF
Text Generation
•
Updated
Jul 3, 2024
SheepHuan/Qwen2-7B-Q4_K_M-GGUF
Text Generation
•
Updated
Jul 3, 2024
•
2
SheepHuan/Qwen2-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
Jul 3, 2024
•
1
Gustav0-Freind/gemma-2-27b-Q5_K_S-GGUF
Text Generation
•
Updated
Jul 3, 2024
•
5
victorbur/llama3-8B-DarkIdol-2.1-Uncensored-32K-Q3_K_M-GGUF
Updated
Jul 3, 2024
•
5
•
1
victorbur/llama3-8B-DarkIdol-2.1-Uncensored-32K-Q2_K-GGUF
Updated
Jul 3, 2024
•
2
•
1
win10/35b-beta-long-Q4_K_M-GGUF
Updated
Jul 3, 2024
e2jhiubyiiyvw/gemma-2-9b-it-Q5_K_M-GGUF
Text Generation
•
Updated
Jul 3, 2024
•
6
BitterMiasma/L3-SthenoMaidBlackroot-8B-V1-Q6_K-GGUF
Updated
Jul 3, 2024
•
1
•
1
huggingkot/dolphin-2.9.3-mistral-7B-32k-Q4_K_M-GGUF
Updated
Jul 3, 2024
•
23
•
3
d-schmoltzi/Hermes-2-Pro-Mistral-7B-IQ3_XXS-GGUF
Updated
Jul 3, 2024
•
5
serkandyck/Kocdigital-LLM-8b-v0.1-Q4_K_M-GGUF
Updated
Jul 3, 2024
•
6
Previous
1
...
91
92
93
94
95
...
100
Next