abideen/Heimer-dpo-TinyLlama-1.1B
Text Generation
•
Updated
•
21
🤖 TinyLlama Alignment
TinyLlama-1.1B model aligned on Intel's Orca dataset. Comparison of DPO/IPO/KTO.
TinyLlama-1.1B model aligned on Intel's Orca dataset. Comparison of DPO/IPO/KTO.