Collection by
1 day ago
1 day ago
Collections
Discover the best community collections!
Collections including paper arxiv:2304.01373
Collection by
May 30
May 30
-
MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Series
Paper • 2405.19327 • Published • 46 -
LLM360/K2
Text Generation • Updated • 615 • 80 -
OLMo: Accelerating the Science of Language Models
Paper • 2402.00838 • Published • 80 -
LLM360: Towards Fully Transparent Open-Source LLMs
Paper • 2312.06550 • Published • 56
Collection by
Jul 24
Jul 24
-
Training Compute-Optimal Large Language Models
Paper • 2203.15556 • Published • 10 -
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Paper • 1909.08053 • Published • 2 -
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Paper • 1910.10683 • Published • 8 -
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper • 2304.01373 • Published • 8
Collection by
Apr 13
Apr 13
-
Simple linear attention language models balance the recall-throughput tradeoff
Paper • 2402.18668 • Published • 18 -
Linear Transformers with Learnable Kernel Functions are Better In-Context Models
Paper • 2402.10644 • Published • 78 -
Repeat After Me: Transformers are Better than State Space Models at Copying
Paper • 2402.01032 • Published • 22 -
Zoology: Measuring and Improving Recall in Efficient Language Models
Paper • 2312.04927 • Published • 2
Collection by
Dec 29, 2023
Dec 29, 2023
-
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper • 2304.01373 • Published • 8 -
Llama 2: Open Foundation and Fine-Tuned Chat Models
Paper • 2307.09288 • Published • 242 -
Mistral 7B
Paper • 2310.06825 • Published • 47 -
microsoft/phi-2
Text Generation • Updated • 233k • 3.24k
Collection by
Aug 1
Aug 1
-
Attention Is All You Need
Paper • 1706.03762 • Published • 44 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 14 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 7 -
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Paper • 1910.01108 • Published • 14
Collection by
3 days ago
3 days ago
Collection by
Nov 21, 2023
Nov 21, 2023