TinyLlama-1.1B DPO - a SebastianSchramm Collection

SebastianSchramm 's Collections

TinyLlama-1.1B DPO

UniversalNER 4bit

TinyLlama-1.1B DPO

updated Nov 14, 2023

Apply SFT and DPO to TinyLlama 1.1B

SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-sft-lora

Text Generation • Updated Nov 12, 2023 • 5
SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-sft-lora-merged

Text Generation • Updated Nov 12, 2023 • 12
SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-dpo-lora

Text Generation • Updated Nov 13, 2023 • 8
SebastianSchramm/tinyllama-1.1B-intermediate-step-715k-1.5T-dpo-lora-merged

Text Generation • Updated Nov 13, 2023 • 1.52k • 1