Uploaded model
- Developed by: Ashian1973
- License: apache-2.0
- Finetuned from model : llm-jp/llm-jp-3-3.7b
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model’s pipeline type.
Model tree for Ashian1973/llm-jp-3-3.7b-FT-DPO
Base model
llm-jp/llm-jp-3-3.7b