Commit
•
a5136ae
1
Parent(s):
400e233
Update README.md
Browse files
README.md
CHANGED
@@ -12,6 +12,10 @@ library_name: mlx
|
|
12 |
|
13 |
# Notus 7B v1
|
14 |
|
|
|
|
|
|
|
|
|
15 |
Notus is a collection of fine-tuned models using Direct Preference Optimization (DPO) and related RLHF techniques following a data-first approach. This model is the first version, fine-tuned with DPO on top of [`alignment-handbook/zephyr-7b-sft-full`](https://huggingface.co/alignment-handbook/zephyr-7b-sft-full), which is the SFT model produced to create [`HuggingFaceH4/zephyr-7b-beta`](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta).
|
16 |
|
17 |
More information at [argilla/notus-7b-v1](https://huggingface.co/argilla/notus-7b-v1)
|
|
|
12 |
|
13 |
# Notus 7B v1
|
14 |
|
15 |
+
<div align="center">
|
16 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/60f0608166e5701b80ed3f02/dj-spsk9eXMMXVGxK6jRz.png" alt="A banner representing Notus, the wind god of the south, in a mythical and artistic style. The banner features a strong, swirling breeze, embodying the warm, wet character of the southern wind. Gracefully flowing across the scene are several paper planes, caught in the gentle yet powerful gusts of Notus. The background is a blend of warm colors, symbolizing the heat of the south, with hints of blue and green to represent the moisture carried by this wind. The overall atmosphere is one of dynamic movement and warmth."/>
|
17 |
+
</div>
|
18 |
+
|
19 |
Notus is a collection of fine-tuned models using Direct Preference Optimization (DPO) and related RLHF techniques following a data-first approach. This model is the first version, fine-tuned with DPO on top of [`alignment-handbook/zephyr-7b-sft-full`](https://huggingface.co/alignment-handbook/zephyr-7b-sft-full), which is the SFT model produced to create [`HuggingFaceH4/zephyr-7b-beta`](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta).
|
20 |
|
21 |
More information at [argilla/notus-7b-v1](https://huggingface.co/argilla/notus-7b-v1)
|