Nous-Hermes-13b-Chinese-GPTQ / quantize_config.json
coyude's picture
Upload quantize_config.json
4a8af99
raw
history blame
84 Bytes
{
"bits": 4,
"desc_act": false,
"group_size": 128,
"true_sequential": true
}