QuietImpostor commited on
Commit
f34b11d
·
verified ·
1 Parent(s): e13f9f7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -6
README.md CHANGED
@@ -1,5 +1,4 @@
1
  ---
2
- base_model: QuietImpostor/Llama-3.1-Mini
3
  language:
4
  - en
5
  license: apache-2.0
@@ -12,12 +11,22 @@ tags:
12
  - sft
13
  ---
14
 
15
- # Uploaded model
16
 
17
- - **Developed by:** QuietImpostor
18
- - **License:** apache-2.0
19
- - **Finetuned from model :** QuietImpostor/Llama-3.1-Mini
20
 
21
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
 
 
 
 
 
 
 
 
22
 
23
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
 
2
  language:
3
  - en
4
  license: apache-2.0
 
11
  - sft
12
  ---
13
 
14
+ # Llama 3.1 Mini - LoRA Finetuned
15
 
16
+ ## Model Description
17
+ This model is a LoRA-finetuned version of the Llama 3.1 Mini model, which is a pruned variant of the Llama 3.1 8B model. The original Llama 3.1 Mini was created by pruning the larger model to approximately 3 billion parameters, and this version has been further adapted using Low-Rank Adaptation (LoRA) to enhance its capabilities.
 
18
 
19
+ ## Limitations
20
+
21
+ Please note that this model, like its base version, may exhibit biases present in its training data and should be used with appropriate care and consideration.
22
+
23
+ ## Training Data
24
+
25
+ The base model (Llama 3.1 Mini) was trained on my personal Claude 3 Opus and Claude 3.5 Sonnet dataset, with some synthetic pairs added on with Gemma 2 9B it being the user, and Llama 3 70B through Groq being the assistant. I have also used Guanaco alongside everything else.
26
+
27
+ [Your citation or acknowledgment for the finetuned version]
28
+
29
+ ## License
30
+ [Specify the license under which you're releasing this model, ensuring it complies with the original Llama 3.1 license]
31
 
32
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)