Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ibm
/
merlinite-7b-GGUF
like
4
Follow
IBM
2,104
Transformers
GGUF
English
mistral
merlinite
ibm
lab
labrador
labradorite
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
Merlinite 7b - GGUF
Merlinite 7b - GGUF
4-bit quantized version of
ibm/merlinite-7b
Downloads last month
80
GGUF
Model size
7.24B params
Architecture
llama
4-bit
Q4_K_M
Inference API
Unable to determine this model’s pipeline type. Check the
docs
.
Model tree for
ibm/merlinite-7b-GGUF
Base model
mistralai/Mistral-7B-v0.1
Finetuned
ibm/merlinite-7b
Quantized
(
5
)
this model