nm-testing
/

Meta-Llama-3-70B-Instruct-W8A8-Dynamic-Per-Token-test

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

Meta-Llama-3-70B-Instruct-W8A8-Dynamic-Per-Token-test / config.json

Commit History

Updated compression_config to quantization_config

2cb8f6c
verified

mgoin commited on 10 days ago

Update config.json

30a6435
verified

robertgshaw2 commited on Jul 23

Upload folder using huggingface_hub

17f4f10
verified

robertgshaw2 commited on Jul 23