gghfez
/

WizardLM-2-22B-RP-exl2

Text Generation

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

gghfez commited on Dec 31, 2024

Commit

c4e80b1

·

verified ·

1 Parent(s): 232ba51

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -18,8 +18,8 @@ EXL2 Quants of [gghfez/WizardLM-2-22B-RP](https://huggingface.co/gghfez/WizardLM
 |BPW|Size|
 |---|---|
 |[8_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/8_0)|18.2 GiB|
-|[6_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/6_0)|14.0 GiB|
-|[5_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/5_0)|12.0 GiB|
 Original Model Card:

 |BPW|Size|
 |---|---|
 |[8_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/8_0)|18.2 GiB|
+|[6_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/6_0)|15.8 GiB|
+|[5_0](https://huggingface.co/gghfez/WizardLM-2-22B-RP-exl2/tree/5_0)|13.2 GiB|
 Original Model Card: