Hugging Face's logo

RioShiina
/
Swallow-70b-instruct-exl2

Text Generation
Japanese
English
Model card Files Community
RioShiina commited on
Commit
c776c3b
•
1 Parent(s): ad0e49f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -7,7 +7,7 @@ base_model: tokyotech-llm/Swallow-70b-instruct-hf
7
  pipeline_tag: text-generation
8
  ---
9
 
10
- **[2.2bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/4.0bpw)** (high quality loss, only for 24GB vRAM test.)
11
  **[4.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/4.0bpw)**
12
  **[6.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/6.0bpw)**
13
  **[8.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/8.0bpw)**
 
7
  pipeline_tag: text-generation
8
  ---
9
 
10
+ **[2.2bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/2.2bpw)** (high quality loss, only for 24GB vRAM test.)
11
  **[4.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/4.0bpw)**
12
  **[6.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/6.0bpw)**
13
  **[8.0bpw](https://huggingface.co/rioshiina/Swallow-70b-instruct-exl2/tree/8.0bpw)**