continue pretraining mlm
#3
by
jiahaunluo
- opened
Thanks for the awesome work.
We would like to continue pretrain mlm model using run_mlm.py. But I encounter this ERROR:
This is the args:
I will update the modeling.py by https://huggingface.co./Alibaba-NLP/new-impl/discussions/5, this works for me.
izhx
changed discussion status to
closed