Nanotron Research

community

Activity Feed Request to join this org

AI & ML interests

Large scale distributed AI model training, model parallelisation, low-level GPU acceleration, make GPUs go brrrrr

Recent Activity

eliebak new activity about 3 hours ago

nanotron/ultrascale-playbook:typo

eliebak new activity about 4 hours ago

nanotron/ultrascale-playbook:seq-len-fix

eliebak updated a Space about 4 hours ago

nanotron/ultrascale-playbook

View all activity

nanotron's activity

eliebak

in nanotron/ultrascale-playbook about 3 hours ago

typo

#90 opened about 5 hours ago by

eliebak

in nanotron/ultrascale-playbook about 4 hours ago

seq-len-fix

#91 opened about 4 hours ago by

eliebak

updated a Space about 4 hours ago

The Ultra-Scale Playbook

The ultimate guide to training LLM on large GPU Clusters

neuralink

in nanotron/ultrascale-playbook 1 day ago

Make hash section working

#89 opened 1 day ago by

eliebak

in nanotron/ultrascale-playbook 3 days ago

Few Errors

#86 opened 6 days ago by

Typos

#80 opened 8 days ago by

Link to torchao is broken

#85 opened 6 days ago by

fix-typos

#88 opened 3 days ago by

nouamanetazi

in nanotron/ultrascale-playbook 6 days ago

Typos

#81 opened 8 days ago by

How to download as pdf?

#74 opened 9 days ago by

ZeRO-3 vs FSDP 1 vs FSDP 2

#75 opened 9 days ago by

Fix typo

#76 opened 9 days ago by

Thanks for sharing. Was looking for similar research to get to know about compute(AI+GPU)

#79 opened 9 days ago by

Typos

#80 opened 8 days ago by

Questions?

#84 opened 6 days ago by

Make it easier to import into reader applications

#77 opened 9 days ago by

dark-mode

#82 opened 8 days ago by

More ressources

#73 opened 9 days ago by

thomwolf

in nanotron/ultrascale-playbook 7 days ago

final final final typos

#72 opened 9 days ago by

thomwolf

updated a Space 7 days ago

The Ultra-Scale Playbook

The ultimate guide to training LLM on large GPU Clusters