Update README.md
Browse files
README.md
CHANGED
@@ -1,5 +1,4 @@
|
|
1 |
---
|
2 |
-
base_model: QuietImpostor/Llama-3.1-Mini
|
3 |
language:
|
4 |
- en
|
5 |
license: apache-2.0
|
@@ -12,12 +11,22 @@ tags:
|
|
12 |
- sft
|
13 |
---
|
14 |
|
15 |
-
#
|
16 |
|
17 |
-
|
18 |
-
-
|
19 |
-
- **Finetuned from model :** QuietImpostor/Llama-3.1-Mini
|
20 |
|
21 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
22 |
|
23 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
1 |
---
|
|
|
2 |
language:
|
3 |
- en
|
4 |
license: apache-2.0
|
|
|
11 |
- sft
|
12 |
---
|
13 |
|
14 |
+
# Llama 3.1 Mini - LoRA Finetuned
|
15 |
|
16 |
+
## Model Description
|
17 |
+
This model is a LoRA-finetuned version of the Llama 3.1 Mini model, which is a pruned variant of the Llama 3.1 8B model. The original Llama 3.1 Mini was created by pruning the larger model to approximately 3 billion parameters, and this version has been further adapted using Low-Rank Adaptation (LoRA) to enhance its capabilities.
|
|
|
18 |
|
19 |
+
## Limitations
|
20 |
+
|
21 |
+
Please note that this model, like its base version, may exhibit biases present in its training data and should be used with appropriate care and consideration.
|
22 |
+
|
23 |
+
## Training Data
|
24 |
+
|
25 |
+
The base model (Llama 3.1 Mini) was trained on my personal Claude 3 Opus and Claude 3.5 Sonnet dataset, with some synthetic pairs added on with Gemma 2 9B it being the user, and Llama 3 70B through Groq being the assistant. I have also used Guanaco alongside everything else.
|
26 |
+
|
27 |
+
[Your citation or acknowledgment for the finetuned version]
|
28 |
+
|
29 |
+
## License
|
30 |
+
[Specify the license under which you're releasing this model, ensuring it complies with the original Llama 3.1 license]
|
31 |
|
32 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|