Added q5_1 quant
Browse filesHere's a q5_1 quantized version of the WavTokenizer, had to make a few tweaks to quantize it correctly, as there are some tensors with incompatible shapes. But it works correctly with the current version on llama.cpp, and is a somewhat smaller. Feel free to try it.
- .gitattributes +1 -0
- WavTokenizer-Large-75-Q5_1.gguf +3 -0
.gitattributes
CHANGED
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
WavTokenizer-Large-75-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
WavTokenizer-Large-75-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
WavTokenizer-Large-75-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
|
WavTokenizer-Large-75-Q5_1.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ad182c884841444ce6b70e8a61a7d084d9731320364dc633c9ef42632fc63d25
|
3 |
+
size 73319616
|