Hugging Face's logo

darthhexx
/
Meta-Llama-3.1-8B-Instruct-FP8

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
Inference Endpoints
fp8
Model card Files Community

Model Details

This model is an FP8 quantization of the meta-llama/Meta-Llama-3.1-8B-Instruct model in the safetensors format.

Downloads last month
7
Safetensors
Model size
8.03B params
Tensor type
BF16
·
F8_E4M3
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.