Natkituwu
/

mistral-doryV2-12b-8.0bpw-exl2

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Natkituwu commited on Jul 22

Commit

c56855d

•

1 Parent(s): 6fdebd7

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -7,6 +7,9 @@ language:
 - en
 library_name: transformers
 ---
 # Dory 12b (v2)
 (redone) redone instruct finetune of mistral nemo 12b's base. *not* (E)RP-focused, leave that to drummer.

 - en
 library_name: transformers
 ---
+8bpw h8 exl2 quant of (https://huggingface.co/BeaverAI/mistral-doryV2-12b)
 # Dory 12b (v2)
 (redone) redone instruct finetune of mistral nemo 12b's base. *not* (E)RP-focused, leave that to drummer.