Update README.md
Browse files
README.md
CHANGED
@@ -3,6 +3,11 @@ library_name: transformers
|
|
3 |
license: mit
|
4 |
---
|
5 |
|
|
|
|
|
|
|
|
|
|
|
6 |
# LLM Model Merging
|
7 |
|
8 |
<div align="center">
|
@@ -16,20 +21,6 @@ license: mit
|
|
16 |
</a>
|
17 |
</div>
|
18 |
<br/>
|
19 |
-
<div align="center">
|
20 |
-
<p>Liked our work? give us a ⭐!</p>
|
21 |
-
</div>
|
22 |
-
|
23 |
-
<p align="center">
|
24 |
-
<img src="./leaderboard-ss.png" height="70%" width="70%"/>
|
25 |
-
</p>
|
26 |
-
|
27 |
-
This repository contains the notebook and sample `yml` file for linear model mergind.
|
28 |
-
|
29 |
-
In this specific case, I typed `llama-3` into the open LLM leaderboard, took the best 3 models, merged them and created
|
30 |
-
a better ranking model wihtout any training.
|
31 |
-
|
32 |
-
As the main libraries we will be using [mergekit](https://github.com/arcee-ai/mergekit).
|
33 |
|
34 |
## YouTube Tutorial
|
35 |
<div align="center">
|
@@ -39,4 +30,12 @@ As the main libraries we will be using [mergekit](https://github.com/arcee-ai/me
|
|
39 |
<a href="https://youtu.be/gNXBp3wttFU">
|
40 |
<img src="./assets/thumbnail1-button.png" height="85%" width="85%%"/>
|
41 |
</a>
|
42 |
-
</div>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
license: mit
|
4 |
---
|
5 |
|
6 |
+
---
|
7 |
+
library_name: transformers
|
8 |
+
license: mit
|
9 |
+
---
|
10 |
+
|
11 |
# LLM Model Merging
|
12 |
|
13 |
<div align="center">
|
|
|
21 |
</a>
|
22 |
</div>
|
23 |
<br/>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
|
25 |
## YouTube Tutorial
|
26 |
<div align="center">
|
|
|
30 |
<a href="https://youtu.be/gNXBp3wttFU">
|
31 |
<img src="./assets/thumbnail1-button.png" height="85%" width="85%%"/>
|
32 |
</a>
|
33 |
+
</div>
|
34 |
+
|
35 |
+
## GitHub
|
36 |
+
You can find the GitHub from here; https://github.com/uygarkurt/Model-Merge
|
37 |
+
|
38 |
+
In this specific case, I typed `llama-3` into the open LLM leaderboard, took the best 3 models, merged them and created
|
39 |
+
a better ranking model wihtout any training.
|
40 |
+
|
41 |
+
As the main libraries we will be using [mergekit](https://github.com/arcee-ai/mergekit).
|