Thireus
/

WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2

Text Generation

Model card Files Files and versions Community

Thireus commited on Sep 17, 2023

Commit

5a36c26

·

1 Parent(s): f54f432

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -53,7 +53,7 @@ ASSISTANT:
 | -------------- | --- | ------------- | --- | ---------------- | --- | ---------- |
 | [WizardLM 70B V1.0](https://huggingface.co/WizardLM/WizardLM-70B-V1.0) | → | [WizardLM 70B V1.0-HF](https://huggingface.co/simsim314/WizardLM-70B-V1.0-HF)* | → | Safetensor** | → | EXL2 |
-Example to convert WizardLM-70B-V1.0-HF_float16_safetensored to EXL2 4.0 bpw with 6-bit head:
 ```
 mkdir -p ~/EXL2/WizardLM-70B-V1.0-HF_4bit # Create the output directory

 | -------------- | --- | ------------- | --- | ---------------- | --- | ---------- |
 | [WizardLM 70B V1.0](https://huggingface.co/WizardLM/WizardLM-70B-V1.0) | → | [WizardLM 70B V1.0-HF](https://huggingface.co/simsim314/WizardLM-70B-V1.0-HF)* | → | Safetensor** | → | EXL2 |
+Example to convert WizardLM-70B-V1.0-HF to EXL2 4.0 bpw with 6-bit head:
 ```
 mkdir -p ~/EXL2/WizardLM-70B-V1.0-HF_4bit # Create the output directory