Hugging Face's logo

gelukuMLG
/
llama-3-stinky-v2-8B-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
gelukuMLG commited on
Commit
c3b8f2c
•
1 Parent(s): bc0da46

Decided to also add the f32 files used for the quanting. Enjoy

Browse files

Added llama-3-stinky-v2-8B-f32 that has been used for quanting.

Files changed (2) hide show
  1. .gitattributes +1 -0
  2. llama-3-stinky-v2-8B-f32.gguf +3 -0
.gitattributes CHANGED
@@ -44,3 +44,4 @@ llama-3-stinky-v2-8B-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
44
  llama-3-stinky-v2-8B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
45
  llama-3-stinky-v2-8B-F16.gguf filter=lfs diff=lfs merge=lfs -text
46
  llama-3-stinky-v2-8B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
44
  llama-3-stinky-v2-8B-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
45
  llama-3-stinky-v2-8B-F16.gguf filter=lfs diff=lfs merge=lfs -text
46
  llama-3-stinky-v2-8B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ llama-3-stinky-v2-8B-f32.gguf filter=lfs diff=lfs merge=lfs -text
llama-3-stinky-v2-8B-f32.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:829bb621d6cefe3ed536ef19cdee6adfb7cb366177aab53bfabadcd8e27f8461
3
+ size 32128880832