mudler/Minerva-3B-base-v1.0-Q8_0-GGUF
Text Generation
•
Updated
•
8
Quants
Models quantized for LocalAI and llama.cpp
-
-
mudler/Minerva-3B-Instruct-v1.0-Q8_0-GGUF
Text Generation • Updated • 3 -
mudler/Minerva-3B-base-v1.0-Q6_K-GGUF
Text Generation • Updated • 12 -
mudler/Minerva-3B-Instruct-v1.0-Q6_K-GGUF
Text Generation • Updated • 6 -
mudler/Minerva-3B-Instruct-v1.0-Q4_0-GGUF
Text Generation • Updated • 10 -
mudler/Minerva-3B-base-v1.0-Q5_0-GGUF
Text Generation • Updated • 5 -
mudler/prem-1B-chat-Q8_0-GGUF
Text Generation • Updated • 6 -
mudler/prem-1B-chat-Q6_K-GGUF
Text Generation • Updated • 2 -
mudler/Minerva-3B-base-v1.0-Q2_K-GGUF
Text Generation • Updated • 1 -
mudler/Minerva-3B-base-v1.0-Q5_K_M-GGUF
Text Generation • Updated • 7 -
mudler/Minerva-3B-Instruct-v1.0-Q4_K_M-GGUF
Text Generation • Updated • 7 -
mudler/prem-1B-chat-Q5_0-GGUF
Text Generation • Updated • 8 • 1 -
mudler/Minerva-1B-base-v1.0-Q5_K_M-GGUF
Text Generation • Updated • 3 -
mudler/Minerva-1B-base-v1.0-Q4_0-GGUF
Text Generation • Updated • 11 -
mudler/prem-1B-chat-Q4_0-GGUF
Text Generation • Updated • 23 -
mudler/Minerva-350M-base-v1.0-Q8_0-GGUF
Text Generation • Updated • 3 -
mudler/Minerva-350M-base-v1.0-Q5_0-GGUF
Text Generation • Updated • 4 -
mudler/Minerva-350M-base-v1.0-Q4_0-GGUF
Text Generation • Updated • 11 -
mudler/Minerva-3B-base-v1.0-Q4_K_M-GGUF
Text Generation • Updated • 6 -
mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF
Updated • 5 • 1 -
mudler/L3-8B-Stheno-v3.1-Q4_K_M-GGUF
Updated • 27 • 2 -
mudler/llama-3-Stheno-Mahou-8B-Q4_K_M-GGUF
Updated • 13 • 2