Nous-Hermes-13b-Chinese-GPTQ / quantize_config.json
coyude's picture
Upload quantize_config.json
13a92ff
raw
history blame
83 Bytes
{
"bits": 4,
"desc_act": true,
"group_size": 128,
"true_sequential": true
}