solidrust/OrpoLlama-3-8B-AWQ

mlabonne/OrpoLlama-3-8B AWQ

• Model creator: mlabonne
• Original model: OrpoLlama-3-8B

Model Summary

This is an ORPO fine-tune of meta-llama/Meta-Llama-3-8B on 1k samples of mlabonne/orpo-dpo-mix-40k created for this article.

It's a successful fine-tune that follows the ChatML template!

Try the demo: https://huggingface.co./spaces/mlabonne/OrpoLlama-3-8B

🔎 Application

This model uses a context window of 8k. It was trained with the ChatML template.

🏆 Evaluation

Nous

OrpoLlama-4-8B outperforms Llama-3-8B-Instruct on the GPT4All and TruthfulQA datasets.