BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Paper
•
1901.08746
•
Published
•
3
Papers - Text - Bidirectional Encoders
-
-
Pretraining-Based Natural Language Generation for Text Summarization
Paper • 1902.09243 • Published • 2 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 7 -
DeBERTa: Decoding-enhanced BERT with Disentangled Attention
Paper • 2006.03654 • Published • 3 -
DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing
Paper • 2111.09543 • Published • 2 -
Wave Network: An Ultra-Small Language Model
Paper • 2411.02674 • Published • 3