drexample
/

Monstral-123B_5.5bpw_EXL2

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

drexample commited on Nov 14, 2024

Commit

3cc8d13

·

verified ·

1 Parent(s): ac0e74a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,6 +8,6 @@ tags:
 pipeline_tag: text-generation
 library_name: transformers
 ---
-4bpw EXL2 quant of https://huggingface.co/MarsupialAI/Monstral-123B
 Default settings and dataset utilized for measurements.

 pipeline_tag: text-generation
 library_name: transformers
 ---
+5bpw EXL2 quant of https://huggingface.co/MarsupialAI/Monstral-123B
 Default settings and dataset utilized for measurements.