nm-testing
/

llama3-8b-w8_channel-a8_tensor-compressed

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

llama3-8b-w8_channel-a8_tensor-compressed / config.json

Commit History

Updated compression_config to quantization_config

a6678d2
verified

mgoin commited on 10 days ago

Upload folder using huggingface_hub

dc6365d
verified

sadkins65 commited on Jun 7

Upload folder using huggingface_hub

54347c9
verified

sadkins65 commited on May 30