Finetuning scripts for Molmo

#6
by 2U1 - opened

I made a code for fine-tuning Molmo series.
https://github.com/2U1/Molmo-Finetune
However, the model is sort of a preview and has some limitations. It will be updated soon.

For now you can use

  • LoRA/QLoRA
  • Deepspeed
  • Full-finetuning
  • Flexibly select module to train

PRs and feedbacks are always welcome!

Sign up or log in to comment