hugging-quants
/

Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-405B-Instruct-BNB-NF4 / generation_config.json

Commit History

Upload 6 files

58f1ab4
verified

mdouglas HF staff commited on Jul 23, 2024

Upload folder using huggingface_hub

49f9feb
verified

mdouglas HF staff commited on Jul 23, 2024