Hugging Face's logo

LlamaFinetune
/
Meta-Llama-3.1-70B-bnb-4bits

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

Model Card for Model ID

Below is the orginal model card as this is just a 4-bit version of that.

Model Details

Downloads last month
4
Safetensors
Model size
37.4B params
Tensor type
F32
路
FP16
路
U8
路
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.