TheBloke
/

WizardLM-Uncensored-Falcon-40B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Jun 22, 2023

Commit

136a58a

•

1 Parent(s): ca911d3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -63,7 +63,7 @@ So please first update text-generation-webui to the latest version.
 8. In the **Model drop-down**: choose the model you just downloaded, `WizardLM-Uncensored-Falcon-40B-GPTQ`.
 9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
 10. Tick **Trust Remote Code**, followed by **Save Settings**
-11. Make sure Click **Reload**.
 12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 ## Python inference

 8. In the **Model drop-down**: choose the model you just downloaded, `WizardLM-Uncensored-Falcon-40B-GPTQ`.
 9. Make sure **Loader** is set to **AutoGPTQ**. This model will not work with ExLlama or GPTQ-for-LLaMa.
 10. Tick **Trust Remote Code**, followed by **Save Settings**
+11. Click **Reload**.
 12. Once it says it's loaded, click the **Text Generation tab** and enter a prompt!
 ## Python inference