Update README.md
Browse files
README.md
CHANGED
|
@@ -20,4 +20,20 @@ license: apache-2.0
|
|
| 20 |
|
| 21 |
# DoppelKartoffel-Mistral-Nemo-23B
|
| 22 |
|
| 23 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
# DoppelKartoffel-Mistral-Nemo-23B
|
| 22 |
|
| 23 |
+
[nbeerbower/GigaPotato-Mistral-Nemo-23B](https://huggingface.co/nbeerbower/GigaPotato-Mistral-Nemo-23B) finetuned on:
|
| 24 |
+
* [nbeerbower/GreatFirewall-DPO](https://huggingface.co/datasets/nbeerbower/GreatFirewall-DPO)
|
| 25 |
+
* [nbeerbower/Schule-DPO](https://huggingface.co/datasets/nbeerbower/Schule-DPO)
|
| 26 |
+
* [nbeerbower/Purpura-DPO](https://huggingface.co/datasets/nbeerbower/Purpura-DPO)
|
| 27 |
+
* [nbeerbower/Arkhaios-DPO](https://huggingface.co/datasets/nbeerbower/Arkhaios-DPO)
|
| 28 |
+
* [jondurbin/truthy-dpo-v0.1](https://huggingface.co/datasets/jondurbin/truthy-dpo-v0.1)
|
| 29 |
+
* [antiven0m/physical-reasoning-dpo](https://huggingface.co/datasets/antiven0m/physical-reasoning-dpo)
|
| 30 |
+
* [flammenai/Date-DPO-NoAsterisks](https://huggingface.co/datasets/flammenai/Date-DPO-NoAsterisks)
|
| 31 |
+
* [flammenai/Prude-Phi3-DPO](https://huggingface.co/datasets/flammenai/Prude-Phi3-DPO)
|
| 32 |
+
* [Atsunori/HelpSteer2-DPO](https://huggingface.co/datasets/Atsunori/HelpSteer2-DPO)
|
| 33 |
+
* [jondurbin/gutenberg-dpo-v0.1](https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1)
|
| 34 |
+
* [nbeerbower/gutenberg2-dpo](https://huggingface.co/datasets/nbeerbower/gutenberg2-dpo)
|
| 35 |
+
* [nbeerbower/gutenberg-moderne-dpo](https://huggingface.co/datasets/nbeerbower/gutenberg-moderne-dpo).
|
| 36 |
+
|
| 37 |
+
### Method
|
| 38 |
+
|
| 39 |
+
[QLoRA ORPO tuned](https://mlabonne.github.io/blog/posts/2024-04-19_Fine_tune_Llama_3_with_ORPO.html) with 8x A100 for 1 epoch.
|