rombodawg commited on
Commit
e2961f7
1 Parent(s): 443cab0

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+
4
+ base_model:
5
+
6
+ - Qwen/Qwen2.5-1.5B-Instruct
7
+ license: apache-2.0
8
+ ---
9
+ # Rombos-LLM-V2.5-Qwen-1.5b
10
+
11
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642cc1c253e76b4c2286c58e/TPFw2wUx9kyGInJrb6PIl.jpeg)
12
+
13
+ Rombos-LLM-V2.5-Qwen-1.5b is a continues finetuned version of Qwen2.5-1.5B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the *Ties* merge method
14
+
15
+ This version of the model shows higher performance than the original instruct and base models.
16
+
17
+ Quants: (Coming soon)
18
+
19
+ GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-1.5b-GGUF
20
+
21
+
22
+ Benchmarks: (Coming soon)