Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier Paper β’ 2412.04261 β’ Published Dec 5, 2024 β’ 1
C4AI Aya Expanse Collection Aya Expanse is an open-weight research release of a model with highly advanced multilingual capabilities. β’ 3 items β’ Updated 26 days ago β’ 30
To Code, or Not To Code? Exploring Impact of Code in Pre-training Paper β’ 2408.10914 β’ Published Aug 20, 2024 β’ 41
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning Paper β’ 2402.06619 β’ Published Feb 9, 2024 β’ 54
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection Paper β’ 2403.03507 β’ Published Mar 6, 2024 β’ 183
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model Paper β’ 2402.07827 β’ Published Feb 12, 2024 β’ 45