yejingfu
/

q-Meta-Llama-3.1-8B-Instruct_w8a8

Model card Files Files and versions Community

q-Meta-Llama-3.1-8B-Instruct_w8a8 / quant_config.json

linke

Add wegiht files

a5f6fa3 25 days ago

65 Bytes

	{
	"w_bit": 8,
	"version": "MIX",
	"q_group_size": 128
	}