Hugging Face's logo

Felladrin
/
gguf-Lite-Mistral-150M-v2-Instruct

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
Felladrin commited on
Commit
071a511
•
1 Parent(s): e43e5e0

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. .gitattributes +2 -0
  2. Lite-Mistral-150M-v2-Instruct.IQ1_S.gguf +3 -0
  3. Lite-Mistral-150M-v2-Instruct.IQ2_XXS.gguf +3 -0
  4. Lite-Mistral-150M-v2-Instruct.IQ3_XXS.gguf +3 -0
  5. Lite-Mistral-150M-v2-Instruct.IQ4_XS.gguf +2 -2
  6. Lite-Mistral-150M-v2-Instruct.Q5_K.gguf +2 -2
  7. Lite-Mistral-150M-v2-Instruct.Q6_K.gguf +2 -2
  8. Lite-Mistral-150M-v2-Instruct.Q8_0.gguf +2 -2
  9. Lite-Mistral-150M-v2-Instruct.gguf +3 -0
  10. imatrix.dat +0 -0
.gitattributes CHANGED
@@ -50,3 +50,5 @@ Lite-Mistral-150M-v2-Instruct.F16.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
50
  Lite-Mistral-150M-v2-Instruct.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
51
  Lite-Mistral-150M-v2-Instruct.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
52
  Lite-Mistral-150M-v2-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
50
  Lite-Mistral-150M-v2-Instruct.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
51
  Lite-Mistral-150M-v2-Instruct.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
52
  Lite-Mistral-150M-v2-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Lite-Mistral-150M-v2-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Lite-Mistral-150M-v2-Instruct.gguf filter=lfs diff=lfs merge=lfs -text
Lite-Mistral-150M-v2-Instruct.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a6bb79aec05c24cd6660fd6e9b9da43d8a306380e52eabbd60297182c7350ee
3
+ size 48342368
Lite-Mistral-150M-v2-Instruct.IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de5aa40e2d8a02f06fd0f92316f29c096366548de403e472ab24d4daf51b9a18
3
+ size 54166880
Lite-Mistral-150M-v2-Instruct.IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4e9174118171d7a91577a779648f3a4d9fecbabeae99f2f8b7970b22d97c137
3
+ size 69247328
Lite-Mistral-150M-v2-Instruct.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9beb1570e85e951f5876b4ea0b0247eb20a0769e2cc9d91acfce8e020192cce1
3
- size 91236800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fe49bac5a520a030b5ba84f68ecbedd162abd91ddc119b7b41ed51351356d5e
3
+ size 91236704
Lite-Mistral-150M-v2-Instruct.Q5_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a615d148e06a789059598d7b6434870e98dbba4f9a97def83795bbdaeaad5611
3
- size 113872832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91e6a06d1a27bfccde57cde174964900efb7f9e727bab41efa72c52bea1153b0
3
+ size 113872736
Lite-Mistral-150M-v2-Instruct.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4aa4db69b44178a7cd97f83b3d52d01c16f57f723daf7cd93d2898d579fe2541
3
- size 129200576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcaea06b91a0c2192a232ad3b15a8942ec2ac0713af43cfc5d4dd9fa27fa3f18
3
+ size 129200480
Lite-Mistral-150M-v2-Instruct.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ba7b0c6c91fbfdb9d33e9dd28133c393feafea9de352a7a83c2d6466cb2d0643
3
- size 167102912
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88c323a3fafc7bd2fd1107f89b490a2383314a40410fae16a8ec3a2fd714cbc9
3
+ size 167102816
Lite-Mistral-150M-v2-Instruct.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6cb4135f0cc0f7b44dbf40a52ae1c2c80f83b146e45a61806e1fa36058e50d67
3
+ size 313821344
imatrix.dat CHANGED
Binary files a/imatrix.dat and b/imatrix.dat differ