Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch
Paper
•
2501.18512
•
Published
•
25
•
5
Arthur Douillard
ArthurDouillard
AI & ML interests
Continual Learning, Computer Vision, Transformers
Recent Activity
commented on
a paper
9 days ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
upvoted
a
paper
9 days ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
commented on
a paper
9 days ago
Streaming DiLoCo with overlapping communication: Towards a Distributed
Free Lunch
Organizations
None yet