Hugging Face's logo

LlamaFinetune
/
Meta-Llama-3.1-8B-bnb-4bits

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

Model Card for Model ID

Below is the orginal model card as this is just a 4-bit version of that.

Model Details

Downloads last month
61
Safetensors
Model size
4.65B params
Tensor type
FP16
路
F32
路
U8
路
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.