Commit
•
92eaf65
1
Parent(s):
3ee35ce
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,10 @@ tags:
|
|
| 12 |
- sft
|
| 13 |
library_name: transformers
|
| 14 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
# Uploaded model
|
| 17 |
|
|
|
|
| 12 |
- sft
|
| 13 |
library_name: transformers
|
| 14 |
---
|
| 15 |
+
# Info
|
| 16 |
+
|
| 17 |
+
This is a heavily pruned version of Llama 3.1 8B Instruct which went from 32 layers, all the way down to 9. RLHF is definitely required, and is in the works. Hopefully all goes well and we have a Mini Llama 3.1!
|
| 18 |
+
|
| 19 |
|
| 20 |
# Uploaded model
|
| 21 |
|