Liger: Linearizing Large Language Models to Gated Recurrent Structures Paper • 2503.01496 • Published 7 days ago • 14
Liger: Linearizing Large Language Models to Gated Recurrent Structures Paper • 2503.01496 • Published 7 days ago • 14
MoM: Linear Sequence Modeling with Mixture-of-Memories Paper • 2502.13685 • Published 19 days ago • 33
MoM: Linear Sequence Modeling with Mixture-of-Memories Paper • 2502.13685 • Published 19 days ago • 33
CO2: Efficient Distributed Training with Full Communication-Computation Overlap Paper • 2401.16265 • Published Jan 29, 2024 • 1
Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention Paper • 2405.17381 • Published May 27, 2024
LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training Paper • 2411.15708 • Published Nov 24, 2024
MiniMax-01: Scaling Foundation Models with Lightning Attention Paper • 2501.08313 • Published Jan 14 • 274
LASP-2: Rethinking Sequence Parallelism for Linear Attention and Its Hybrid Paper • 2502.07563 • Published 27 days ago • 24
LASP-2: Rethinking Sequence Parallelism for Linear Attention and Its Hybrid Paper • 2502.07563 • Published 27 days ago • 24