roleplaiapp commited on
Commit
6b2d14a
·
verified ·
1 Parent(s): 45e5ada

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ base_model:
5
+ - Qwen/Qwen2-VL-2B-Instruct
6
+ pipeline_tag: image-text-to-text
7
+ library_name: transformers
8
+ tags:
9
+ - llama-cpp
10
+ - Omni-Reasoner-o1
11
+ - gguf
12
+ - Q5_K_M
13
+ - 2B
14
+ - qwen
15
+ - Reasoner
16
+ - llama-cpp
17
+ - prithivMLmods
18
+ - code
19
+ - math
20
+ - chat
21
+ - roleplay
22
+ - text-generation
23
+ - safetensors
24
+ - nlp
25
+ - code
26
+ ---
27
+
28
+ # roleplaiapp/Omni-Reasoner-2B-Q5_K_M-GGUF
29
+
30
+ **Repo:** `roleplaiapp/Omni-Reasoner-2B-Q5_K_M-GGUF`
31
+ **Original Model:** `Omni-Reasoner-o1`
32
+ **Organization:** `prithivMLmods`
33
+ **Quantized File:** `omni-reasoner-2b-q5_k_m.gguf`
34
+ **Quantization:** `GGUF`
35
+ **Quantization Method:** `Q5_K_M`
36
+ **Use Imatrix:** `False`
37
+ **Split Model:** `False`
38
+
39
+ ## Overview
40
+ This is an GGUF Q5_K_M quantized version of [Omni-Reasoner-o1](https://huggingface.co/prithivMLmods/Omni-Reasoner-2B).
41
+
42
+ ## Quantization By
43
+ I often have idle A100 GPUs while building/testing and training the RP app, so I put them to use quantizing models.
44
+ I hope the community finds these quantizations useful.
45
+
46
+ Andrew Webby @ [RolePlai](https://roleplai.app/)