Update README.md

README.md

@@ -32,7 +32,7 @@ pipeline_tag: text-generation
 
 ## Description
 
-This repo contains GPTQ model files for [Stability AI's FreeWilly 2](https://huggingface.co/stabilityai/FreeWilly2).
+This repo contains GPTQ model files for [Stability AI's StableBeluga 2](https://huggingface.co/stabilityai/StableBeluga2).
 
 Multiple GPTQ parameter permutations are provided; see Provided Files below for details of the options provided, their parameters, and the software used to create them.
 
@@ -76,10 +76,10 @@ Each separate quant is in a different branch.  See below for instructions on fet
 
 ## How to download from branches
 
-- In text-generation-webui, you can add `:branch` to the end of the download name, eg `TheBloke/FreeWilly2-GPTQ:gptq-4bit-32g-actorder_True`
+- In text-generation-webui, you can add `:branch` to the end of the download name, eg `TheBloke/StableBeluga2-GPTQ:gptq-4bit-32g-actorder_True`
 - With Git, you can clone a branch with:
 ```
-git clone --branch gptq-4bit-32g-actorder_True https://huggingface.co/TheBloke/FreeWilly2-GPTQ`
+git clone --branch gptq-4bit-32g-actorder_True https://huggingface.co/TheBloke/StableBeluga2-GPTQ`
 ```
 - In Python Transformers code, the branch is the `revision` parameter; see below.
 
@@ -90,13 +90,13 @@ Please make sure you're using the latest version of [text-generation-webui](http
 It is strongly recommended to use the text-generation-webui one-click-installers unless you know how to make a manual install.
 
 1. Click the **Model tab**.
-2. Under **Download custom model or LoRA**, enter `TheBloke/FreeWilly2-GPTQ`.
-  - To download from a specific branch, enter for example `TheBloke/FreeWilly2-GPTQ:gptq-4bit-32g-actorder_True`
+2. Under **Download custom model or LoRA**, enter `TheBloke/StableBeluga2-GPTQ`.
+  - To download from a specific branch, enter for example `TheBloke/StableBeluga2-GPTQ:gptq-4bit-32g-actorder_True`
   - see Provided Files above for the list of branches for each option.
 3. Click **Download**.
 4. The model will start downloading. Once it's finished it will say "Done"
 5. In the top left, click the refresh icon next to **Model**.
-6. In the **Model** dropdown, choose the model you just downloaded: `FreeWilly2-GPTQ`
+6. In the **Model** dropdown, choose the model you just downloaded: `StableBeluga2-GPTQ`
 7. The model will automatically load, and is now ready for use!
 8. If you want any custom settings, set them and then click **Save settings for this model** followed by **Reload the Model** in the top right.
   * Note that you do not need to set GPTQ parameters any more. These are set automatically from the file `quantize_config.json`.
@@ -104,7 +104,7 @@ It is strongly recommended to use the text-generation-webui one-click-installers
 
 ## How to use this GPTQ model from Python code
 
-First make sure you have [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ) installed:
+First make sure you have [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ) 0.3.2 or later installed:
 
 `GITHUB_ACTIONS=true pip install auto-gptq`
 
@@ -114,7 +114,7 @@ Then try the following example code:
 from transformers import AutoTokenizer, pipeline, logging
 from auto_gptq import AutoGPTQForCausalLM, BaseQuantizeConfig
 
-model_name_or_path = "TheBloke/FreeWilly2-GPTQ"
+model_name_or_path = "TheBloke/StableBeluga2-GPTQ"
 model_basename = "gptq_model-4bit--1g"
 
 use_triton = False
@@ -123,7 +123,7 @@ tokenizer = AutoTokenizer.from_pretrained(model_name_or_path, use_fast=True)
 
 model = AutoGPTQForCausalLM.from_quantized(model_name_or_path,
         model_basename=model_basename,
-        inject_fused_attention=False, # Required for TheBloke/FreeWilly2-GPTQ model at this time.
+        inject_fused_attention=False, # Required for Llama 2 70B models at this time.
         use_safetensors=True,
         trust_remote_code=False,
         device="cuda:0",