Hugging Face's logo

telosnex
/
fllama

GGUF
Model card Files Community
jpohhhh commited on
Commit
e6f6e6a
•
1 Parent(s): d12f9ab

Upload DistilGPT2-TinyStories.IQ3_M.gguf

Browse files

Mistral Tiny crashes in ggml assert in latest llama.cpps. This is the smallest gguf I could find that is valid. The recommend demo GGUF creation can't provide output.

Files changed (2) hide show
  1. .gitattributes +1 -0
  2. DistilGPT2-TinyStories.IQ3_M.gguf +3 -0
.gitattributes CHANGED
@@ -44,3 +44,4 @@ stablelm-zephyr-3b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
44
  Hermes-2-Pro-Mistral-7B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
  Phi-3-mini-128k-instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
  dolphin-2.9-llama3-8b-1m-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
 
44
  Hermes-2-Pro-Mistral-7B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
  Phi-3-mini-128k-instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
  dolphin-2.9-llama3-8b-1m-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
47
+ DistilGPT2-TinyStories.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
DistilGPT2-TinyStories.IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a9a41651582d06db9e4a03d9303ff742371be0ebaebf7af1efafba7c77a5e11
3
+ size 73537600