numen-tech
/

Qwen2.5-3B-Instruct-GPTQ-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

Qwen2.5-3B-Instruct-GPTQ-Int4 / config.json

numen-tech's picture

Add weights

5c59785 about 2 months ago

history blame contribute delete

55 Bytes

	{
	"quantization_config": {
	"bits": 4
	}
	}