🔱 Sailor2 Language Models Collection Sailing in South-East Asia with Inclusive Multilingual LLMs • 34 items • Updated 4 days ago • 25
Balancing Pipeline Parallelism with Vocabulary Parallelism Paper • 2411.05288 • Published Nov 8, 2024 • 20
Balancing Pipeline Parallelism with Vocabulary Parallelism Paper • 2411.05288 • Published Nov 8, 2024 • 20 • 3
Running 4 4 Pipeline Parallellism with Controllable Memory 🏆 Calculate and visualize different scheduling strategies
Running 4 4 Pipeline Parallellism with Controllable Memory 🏆 Calculate and visualize different scheduling strategies
Running 20 20 Zero Bubble Pipeline Parallellism 🏆 Optimize pipeline schedules for efficient computing
Running 20 20 Zero Bubble Pipeline Parallellism 🏆 Optimize pipeline schedules for efficient computing