license: apache-2.0 | |
#### Quantization config | |
``` | |
"zero_point": true, | |
"q_group_size": 128, | |
"w_bit": 4, | |
"version": "GEMM" | |
``` | |
#### Work supported by https://datacrunch.io/ | |
##### Quantized by: gradjitta |
license: apache-2.0 | |
#### Quantization config | |
``` | |
"zero_point": true, | |
"q_group_size": 128, | |
"w_bit": 4, | |
"version": "GEMM" | |
``` | |
#### Work supported by https://datacrunch.io/ | |
##### Quantized by: gradjitta |