Uploaded model
- Developed by: pauliusztin
- License: apache-2.0
- Finetuned from model : pauliusztin/TwinLlama-3.1-8B
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 4
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
Model tree for pauliusztin/TwinLlama-3.1-8B-DPO
Base model
unsloth/Meta-Llama-3.1-8B
Finetuned
pauliusztin/TwinLlama-3.1-8B