ycros
/

airoboros-65b-gpt4-1.4.1-PI-8192-fp16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ycros commited on Jul 8, 2023

Commit

225d405

·

1 Parent(s): 8ddf4a1

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -7,7 +7,9 @@ datasets:
 peft file is here: https://huggingface.co/ycros/airoboros-65b-gpt4-1.4.1-PI-8192-peft
-quants are coming.
 ## Overview

 peft file is here: https://huggingface.co/ycros/airoboros-65b-gpt4-1.4.1-PI-8192-peft
+gptq 4bit 32g actorder is here: https://huggingface.co/ycros/airoboros-65b-gpt4-1.4.1-PI-8192-4bit-32g-actorder
+ggml quants are coming.
 ## Overview