Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
Q4_K_M
Inference Endpoints
4-bit precision
AutoTrain Compatible
text-generation-inference
Misc with no match
Eval Results
Merge
8-bit precision
custom_code
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
22
Full-text search
Edit filters
Sort: Trending
Active filters:
Q4_K_M
Clear all
alokabhishek/gemma-7b-it-GGUF
Text Generation
•
Updated
Apr 3, 2024
•
12
•
1
alokabhishek/gemma-1.1-7b-it-GGUF
Text Generation
•
Updated
Apr 8, 2024
•
13
•
1
alokabhishek/Meta-Llama-3-8B-Instruct-GGUF
Text Generation
•
Updated
May 9, 2024
•
15
•
1
roleplaiapp/Llama-3.3-70B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
10 days ago
•
32
roleplaiapp/SmallThinker-3B-Preview-Q4_K_M-GGUF
Text Generation
•
Updated
10 days ago
•
1
roleplaiapp/QwQ-32B-Preview-Q4_K_M-GGUF
Text Generation
•
Updated
7 days ago
•
35
jahdkaran/snowflake-arctic-embed-l-v2.0-Q4_K_M-GGUF
Updated
8 days ago
roleplaiapp/internlm3-8b-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
7 days ago
•
6
roleplaiapp/ReaderLM-v2-Q4_K_M-GGUF
Text Generation
•
Updated
7 days ago
•
20
roleplaiapp/Dria-Agent-a-3B-Q4_K_M-GGUF
Text Generation
•
Updated
7 days ago
•
31
roleplaiapp/Dria-Agent-a-7B-Q4_K_M-GGUF
Text Generation
•
Updated
7 days ago
•
2
roleplaiapp/AceInstruct-72B-Q4_K_M-GGUF
Text Generation
•
Updated
7 days ago
•
26
roleplaiapp/Wayfarer-12B-Q4_K_M-GGUF
Text Generation
•
Updated
7 days ago
•
1
roleplaiapp/Codestral-22B-v0.1-Q4_K_M-GGUF
Text Generation
•
Updated
6 days ago
•
16
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF
Text Generation
•
Updated
6 days ago
•
19
roleplaiapp/AceInstruct-1.5B-Q4_K_M-GGUF
Text Generation
•
Updated
6 days ago
•
23
roleplaiapp/AceInstruct-7B-Q4_K_M-GGUF
Text Generation
•
Updated
6 days ago
•
36
roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF
Text Generation
•
Updated
5 days ago
•
9
roleplaiapp/DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-GGUF
Text Generation
•
Updated
5 days ago
•
23
roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-GGUF
Text Generation
•
Updated
5 days ago
•
23
roleplaiapp/DeepSeek-R1-Distill-Qwen-7B-Q4_K_M-GGUF
Text Generation
•
Updated
5 days ago
•
331
roleplaiapp/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF
Text Generation
•
Updated
5 days ago
•
48