on MPT-30B gradient checkpointing
#7
by
DanielTTY
- opened
Could you do the same for the 30B version? or could you explain to us how it should be done here? thanks
are the changes to allow gradient checkpointing in these lines?:
https://huggingface.co./cekal/mpt-7b-peft-compatible/commit/a5eab52c1c61c1d50a4e01428949f6ff90c73c48