brucethemoose
commited on
Commit
·
efe952e
1
Parent(s):
0f45b9f
Update README.md
Browse files
README.md
CHANGED
@@ -40,7 +40,7 @@ datasets:
|
|
40 |
|
41 |
Just a fiction oriented 4bpw exl2 quantization of https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2
|
42 |
|
43 |
-
Quantized on 300K
|
44 |
|
45 |
If anyone wants sizes other than 4bpw, for more/less context or smaller GPUs, just ask.
|
46 |
***
|
|
|
40 |
|
41 |
Just a fiction oriented 4bpw exl2 quantization of https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2
|
42 |
|
43 |
+
Quantized on 300K tokens of two Vicuna format chats, a sci fi story and a fiction story at a long context. This should yield better storywriting performance than the default exl2 quantization.
|
44 |
|
45 |
If anyone wants sizes other than 4bpw, for more/less context or smaller GPUs, just ask.
|
46 |
***
|