AI Paper of the Day Collection A collection of papers that I think are interesting, one added each day • 277 items • Updated 1 day ago • 35
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization Paper • 2412.17739 • Published Dec 23, 2024 • 40
RegMix: Data Mixture as Regression for Language Model Pre-training Paper • 2407.01492 • Published Jul 1, 2024 • 36