Uploaded model

Developed by: gagan3012
License: apache-2.0
Finetuned from model : gagan3012/Mistral_arabic_dpo

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: 15

Inference Examples

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for gagan3012/dpo-test

Base model

gagan3012/Mistral_arabic_dpo

Finetuned

(1)

this model