Orion-zhen
commited on
Commit
•
3c65428
1
Parent(s):
1aecf1d
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-4.0
|
3 |
+
base_model: TheDrummer/Star-Command-R-32B-v1
|
4 |
+
pipeline_tag: text-generation
|
5 |
+
quantized_by: Orion-zhen
|
6 |
+
---
|
7 |
+
|
8 |
+
# Star-Command-R
|
9 |
+
|
10 |
+
These exl2 models are quantized using my [pixiv-novel](https://huggingface.co/datasets/Orion-zhen/tagged-pixiv-novel) as calibration.
|
11 |
+
|
12 |
+
- [8.0bpw](https://huggingface.co/Orion-zhen/Star-Command-R-32B-v1-exl2/tree/8.0)
|
13 |
+
- [6.5bpw](https://huggingface.co/Orion-zhen/Star-Command-R-32B-v1-exl2/tree/6.5)
|
14 |
+
- [5.0bpw](https://huggingface.co/Orion-zhen/Star-Command-R-32B-v1-exl2/tree/5.0)
|
15 |
+
- [4.65bpw](https://huggingface.co/Orion-zhen/Star-Command-R-32B-v1-exl2/tree/4.65)
|
16 |
+
- [4.4bpw](https://huggingface.co/Orion-zhen/Star-Command-R-32B-v1-exl2/tree/4.4)
|
17 |
+
- [4.2bpw](https://huggingface.co/Orion-zhen/Star-Command-R-32B-v1-exl2/tree/4.2)
|
18 |
+
- [4.0bpw](https://huggingface.co/Orion-zhen/Star-Command-R-32B-v1-exl2/tree/4.0)
|