Article
Finally, a Replacement for BERT: Introducing ModernBERT
โข
499
Loved it, thanks for having done the work, explained it and provided the new BERT model.
I was wondering how much you would gain over ModernBERT-Base by distilling ModernBERT-Large back into a ModernBERT-Base sized model. Any ideas if that is worth doing ?