Hugging Face's logo

Thireus
/
WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2

Text Generation
Transformers
llama
Model card Files Community
Thireus commited on
Commit
7b81965
·
1 Parent(s): 51bbb05

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -43,11 +43,9 @@ ASSISTANT:
43
 
44
  ## Quantization process
45
 
46
- Original Model --> Float16 Model --> Safetensor Model --> EXL2 Model
47
-
48
- Example:
49
-
50
- [WizardLM 70B V1.0](https://huggingface.co/WizardLM/WizardLM-70B-V1.0) --> [WizardLM 70B V1.0-HF](https://huggingface.co/simsim314/WizardLM-70B-V1.0-HF) --> Safetensor --> EXL2
51
 
52
  Use any one of the following scripts to convert your float16 pytorch_model bin files to safetensors:
53
 
 
43
 
44
  ## Quantization process
45
 
46
+ | Original Model | --> | Float16 Model | --> | Safetensor Model | --> | EXL2 Model |
47
+ | -------------- | --- | ------------- | --- | ---------------- | --- | ---------- |
48
+ | [WizardLM 70B V1.0](https://huggingface.co/WizardLM/WizardLM-70B-V1.0) | --> | [WizardLM 70B V1.0-HF](https://huggingface.co/simsim314/WizardLM-70B-V1.0-HF) | --> | Safetensor | --> | EXL2 |
 
 
49
 
50
  Use any one of the following scripts to convert your float16 pytorch_model bin files to safetensors:
51