Added more quants

README.md

@@ -25,8 +25,8 @@ Prompts: Alpaca format natively supported, although ChatML was used during testi
 
 Download options:
 * [full weights](https://huggingface.co/grimjim/fireblossom-32K-7B)
-* [Q8_0 GGUF](https://huggingface.co/grimjim/fireblossom-32K-7B-GGUF)
-* [8.0bpw h8 exl2](https://huggingface.co/grimjim/fireblossom-32K-7B-8.0bpw_h8_exl2)
+* [GGUF quants](https://huggingface.co/grimjim/fireblossom-32K-7B-GGUF)
+* [8.0bpw h8 exl2 quant](https://huggingface.co/grimjim/fireblossom-32K-7B-8.0bpw_h8_exl2)
 
 ## Merge Details
 ### Merge Method

fireblossom-32K-7B.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a0743fa76b459c1957071db7bcf56aae5e742f40a86c4893284cb51f7dbfe5e7
+size 4368439040

fireblossom-32K-7B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e14e2715df5d112ea73af41c7867d894384d71ae49737586a258c2924f162e4
+size 5131409152

fireblossom-32K-7B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3850dc8ff6f093b1aff0693e6ff4c854872c0378e52a2bb271e1a6dfb0076c96
+size 5942064896