neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • Updated Oct 10, 2024 • 19.9k • 30
neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • Updated Oct 19, 2024 • 2.02k • 6
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • Updated Oct 10, 2024 • 10.9k • 19