MetaIX
/

GPT4-X-Alpasta-30b-4bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

MetaIX commited on May 18, 2023

Commit

d5672d4

•

1 Parent(s): 4d4ffc8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -4,7 +4,7 @@ GPT4-X-Alpasta-30b working with Oobabooga's Text Generation Webui and KoboldAI.
 <p><strong>What's included</strong></p>
-<P>GPTQ: 2 quantized versions. One quantized --true-sequential and act-order optimizations, and the other was quantized using --true-sequential --groupsize 128 optimizations (coming soon)</P>
 <P>GGML: 2 quantized versions. One quantized using q4_1, and the other was quantized using q5_0.</P>
 <p><strong>GPU/GPTQ Usage</strong></p>

 <p><strong>What's included</strong></p>
+<P>GPTQ: 2 quantized versions. One quantized --true-sequential and act-order optimizations, and the other was quantized using --true-sequential --groupsize 128 optimizations.</P>
 <P>GGML: 2 quantized versions. One quantized using q4_1, and the other was quantized using q5_0.</P>
 <p><strong>GPU/GPTQ Usage</strong></p>