Hugging Face's logo

MaziyarPanahi
/
calme-3.2-instruct-3b-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
3
MaziyarPanahi commited on
Commit
d4d4832
·
verified ·
1 Parent(s): d36e89a

Upload folder using huggingface_hub (#2)

Browse files

- 059c132375b54e43199d2174f32602365999ed93ece38b0b788cbdd7580f6c5a (24e71b2b027a652acce6ec9fdbb98f358ee7fa7b)
- 664c140f27057bc28c0324acbd01c75e61ef9c65defa4a3615c2a294e8d44eb4 (1ebab01fc36362a9b237345c09181fa250749f0f)
- cba462d038fc17a43c0c058bc0a210b59ebb3fb7846cb6d5c1825cdbcb7abd71 (bbe684e69297fe12db72d53760994bc197e81cc8)
- d4f6c90e529880f31f86c2712b71d1c518f8844616f27b8c65490f8b18ed4972 (3302a3f1ac87eb10bdf0544c6f818238211d35c8)
- 8bd75ae41f90c200f107ce72c2d0f7b13e47a45fab276fe680fe63c16a7791cb (946bc0d4116bb41556c10f988e35211de24955b5)

Files changed (5) hide show
  1. README.md +6 -7
  2. calme-3.2-instruct-3b.Q5_K_M.gguf +2 -2
  3. calme-3.2-instruct-3b.Q6_K.gguf +2 -2
  4. calme-3.2-instruct-3b.Q8_0.gguf +2 -2
  5. calme-3.2-instruct-3b.fp16.gguf +2 -2
README.md CHANGED
@@ -1,4 +1,10 @@
1
  ---
 
 
 
 
 
 
2
  tags:
3
  - quantized
4
  - 2-bit
@@ -9,13 +15,6 @@ tags:
9
  - 8-bit
10
  - GGUF
11
  - text-generation
12
- - text-generation
13
- model_name: calme-3.2-instruct-3b-GGUF
14
- base_model: MaziyarPanahi/calme-3.2-instruct-3b
15
- inference: false
16
- model_creator: MaziyarPanahi
17
- pipeline_tag: text-generation
18
- quantized_by: MaziyarPanahi
19
  ---
20
  # [MaziyarPanahi/calme-3.2-instruct-3b-GGUF](https://huggingface.co/MaziyarPanahi/calme-3.2-instruct-3b-GGUF)
21
  - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
 
1
  ---
2
+ base_model: MaziyarPanahi/calme-3.2-instruct-3b
3
+ inference: false
4
+ model_creator: MaziyarPanahi
5
+ model_name: calme-3.2-instruct-3b-GGUF
6
+ pipeline_tag: text-generation
7
+ quantized_by: MaziyarPanahi
8
  tags:
9
  - quantized
10
  - 2-bit
 
15
  - 8-bit
16
  - GGUF
17
  - text-generation
 
 
 
 
 
 
 
18
  ---
19
  # [MaziyarPanahi/calme-3.2-instruct-3b-GGUF](https://huggingface.co/MaziyarPanahi/calme-3.2-instruct-3b-GGUF)
20
  - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
calme-3.2-instruct-3b.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d50102755dbd14f2cfd668601d2c209fa1fbfa489b57ac733041c81874ebc25
3
- size 2225423520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86da249bfbd8bce5423c42ce81e55f938be9344593ecc3fbf96363f46703f049
3
+ size 2224815264
calme-3.2-instruct-3b.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61025a7ef7c47aa50df08330cdaf59b30d671ef39ad6170419c2e2dd75eeb4dc
3
- size 2538767520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd3ceb7a1eea4323bad00ff71ab07144d8c25c3120905629def5eada606b28e5
3
+ size 2538159264
calme-3.2-instruct-3b.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ade8cff2368882624e0563da866b16207f0c100a57e146ce999f6e376986ac3
3
- size 3286084768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:764958c2be4316cba02cc1322a8b183b28d40f202c0784d3d10613c7d203bc97
3
+ size 3285476512
calme-3.2-instruct-3b.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce57babecfb1b14c8f8094bcf5a7aa9efe5717e169ea70ea65c2d79c82016c54
3
- size 6178925472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d7c6593cfe4260732b6a5c77b85539758fc4bc70790d3344e362969061ef3ac
3
+ size 6178317472