ModelCloud
/

gemma-2-9b-it-gptq-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qubitium commited on Jul 2, 2024

Commit

9d07749

·

verified ·

1 Parent(s): 9349360

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -1,5 +1,5 @@
--Quantized using [GPTQModel v0.9.2](https://github.com/ModelCloud/GPTQModel)
--
 - **bits**: 4
 - **group_size**: 128
 - **desc_act**: false

+Quantized using [GPTQModel v0.9.2](https://github.com/ModelCloud/GPTQModel)
 - **bits**: 4
 - **group_size**: 128
 - **desc_act**: false