nm-testing
/

Meta-llama3-8b-Instruct-quant-FP8

Text Generation

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

Meta-llama3-8b-Instruct-quant-FP8 / config.json

Commit History

Updated compression_config to quantization_config

6cbc172
verified

mgoin commited on 10 days ago

Upload folder using huggingface_hub

e1dbda6
verified

RelaxingSnorlax commited on Jul 19