Hugging Face's logo

Thireus
/
WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2

Text Generation
Transformers
llama
Model card Files Community
Thireus commited on
Commit
332b6e4
·
1 Parent(s): e8c7c07

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -22,6 +22,7 @@ quantized_by: Thireus
22
  | [here](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2/) | 6.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train)* | 49GB | [0.0.2](https://github.com/turboderp/exllamav2/commit/fae6fb296c6db4e3b1314c49c030541bed98acb9) | 4096 | 79 | 56GB | 60GB | 4.0703125 |
23
 
24
  \* wikitext-2-raw-v1
 
25
  \*\* evaluated with text-generation-webui ExLlama v0.0.2 on wikitext-2-raw-v1 (stride 512 and max_length 4096)
26
 
27
  ## Description:
 
22
  | [here](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2/) | 6.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train)* | 49GB | [0.0.2](https://github.com/turboderp/exllamav2/commit/fae6fb296c6db4e3b1314c49c030541bed98acb9) | 4096 | 79 | 56GB | 60GB | 4.0703125 |
23
 
24
  \* wikitext-2-raw-v1
25
+
26
  \*\* evaluated with text-generation-webui ExLlama v0.0.2 on wikitext-2-raw-v1 (stride 512 and max_length 4096)
27
 
28
  ## Description: