TheBloke
/

WizardLM-Uncensored-Falcon-40B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Jun 15, 2023

Commit

f77aaa6

•

1 Parent(s): 2627a89

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -125,8 +125,7 @@ It was created without group_size to reduce VRAM usage, and with `desc_act` (act
 * `gptq_model-4bit--1g.safetensors`
   * Works only with latest AutoGPTQ CUDA, compiled from source as of commit `3cb1bf5`
     * At this time it does not work with AutoGPTQ Triton, but support will hopefully be added in time.
-  * Works with text-generation-webui using `--autogptq --trust_remote_code`
-    * At this time it does NOT work with one-click-installers
   * Does not work with any version of GPTQ-for-LLaMa
   * Parameters: Groupsize = None. With act-order / desc_act.

 * `gptq_model-4bit--1g.safetensors`
   * Works only with latest AutoGPTQ CUDA, compiled from source as of commit `3cb1bf5`
     * At this time it does not work with AutoGPTQ Triton, but support will hopefully be added in time.
+  * Works with text-generation-webui using `--trust-remote-code`
   * Does not work with any version of GPTQ-for-LLaMa
   * Parameters: Groupsize = None. With act-order / desc_act.