File size: 854 Bytes
9b8b11f 6f95975 3ee35ce 9b8b11f 92eaf65 9b8b11f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
---
base_model: QuietImpostor/Llama-3.1-Mini-Instruct
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- sft
library_name: transformers
---
# Info
This is a heavily pruned version of Llama 3.1 8B Instruct which went from 32 layers, all the way down to 9. RLHF is definitely required, and is in the works. Hopefully all goes well and we have a Mini Llama 3.1!
# Uploaded model
- **Developed by:** QuietImpostor
- **License:** apache-2.0
- **Finetuned from model :** QuietImpostor/Llama-3.1-Mini-Instruct
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|