Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ quantized_by: Thireus
|
|
17 |
|
18 |
| Branch | BITS (-b) | HEAD BITS (-hb) | MEASUREMENT LENGTH (-ml) | LENGTH (-l) | CAL DATASET (-c) | Size | ExLlama | Max Context Length |
|
19 |
| ------ | --------- | --------------- | ------------------------ | ----------- | ---------------- | ---- | ------- | ------------------ |
|
20 |
-
| [main](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2/tree/main) | 4.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train) (wikitext-2-raw-v1) | 33GB | [
|
21 |
|
22 |
## Description:
|
23 |
|
@@ -58,7 +58,7 @@ python convert.py -i ~/float16_safetensored/WizardLM-70B-V1.0-HF -o ~/EXL2/Wizar
|
|
58 |
|
59 |
(*) Use any one of the following scripts to convert your local pytorch_model bin files to safetensors:
|
60 |
|
61 |
-
- https://github.com/turboderp/exllamav2/blob/master/util/convert_safetensors.py (official
|
62 |
- https://huggingface.co/Panchovix/airoboros-l2-70b-gpt4-1.4.1-safetensors/blob/main/bin2safetensors/convert.py (recommended)
|
63 |
- https://gist.github.com/epicfilemcnulty/1f55fd96b08f8d4d6693293e37b4c55e#file-2safetensors-py
|
64 |
- https://github.com/oobabooga/text-generation-webui/blob/main/convert-to-safetensors.py (best for sharding)
|
|
|
17 |
|
18 |
| Branch | BITS (-b) | HEAD BITS (-hb) | MEASUREMENT LENGTH (-ml) | LENGTH (-l) | CAL DATASET (-c) | Size | ExLlama | Max Context Length |
|
19 |
| ------ | --------- | --------------- | ------------------------ | ----------- | ---------------- | ---- | ------- | ------------------ |
|
20 |
+
| [main](https://huggingface.co/Thireus/WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2/tree/main) | 4.0 | 6 | 2048 | 2048 | [0000.parquet](https://huggingface.co/datasets/wikitext/tree/refs%2Fconvert%2Fparquet/wikitext-2-raw-v1/train) (wikitext-2-raw-v1) | 33GB | [v2](https://github.com/turboderp/exllamav2) | 4096 |
|
21 |
|
22 |
## Description:
|
23 |
|
|
|
58 |
|
59 |
(*) Use any one of the following scripts to convert your local pytorch_model bin files to safetensors:
|
60 |
|
61 |
+
- https://github.com/turboderp/exllamav2/blob/master/util/convert_safetensors.py (official ExLlamaV2)
|
62 |
- https://huggingface.co/Panchovix/airoboros-l2-70b-gpt4-1.4.1-safetensors/blob/main/bin2safetensors/convert.py (recommended)
|
63 |
- https://gist.github.com/epicfilemcnulty/1f55fd96b08f8d4d6693293e37b4c55e#file-2safetensors-py
|
64 |
- https://github.com/oobabooga/text-generation-webui/blob/main/convert-to-safetensors.py (best for sharding)
|