Can we perform CPT?
#6
by
architsaxena
- opened
The notebook given on the Model card page is for Supervised FineTuning (SFT).
I want to perform Continued Pre-Training (CPT) on sarvamai/sarvam-2b-v0.5. Is it possible?
yea you can check this out
https://github.com/huggingface/alignment-handbook/blob/main/scripts/run_cpt.py