Article
From DeepSpeed to FSDP and Back Again with Hugging Face Accelerate
- +2
•
61
Stas Bekman
stas
AI & ML interests
Toolmaker. Software creator, optimizer and harmonizer.
Makes things work and fly at Contextual.AI
Training LLM/RAG/Generative AI/Machine Learning/Scalability
Recent Activity
updated
a dataset
30 days ago
stas/gutenberg-100
published
a dataset
30 days ago
stas/gutenberg-100
liked
a Space
about 2 months ago
muellerzr/gpu-tflop-finder
Organizations
published
an
article
over 1 year ago
published
an
article
over 2 years ago
Article
Introducing IDEFICS: An Open Reproduction of State-of-the-art Visual Langage Model
- +9
•
37
published
an
article
about 3 years ago
Article
Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate
•
1
published
an
article
over 3 years ago
Article
The Technology Behind BLOOM Training
•
44
published
an
article
almost 5 years ago
Article
Fit More and Train Faster With ZeRO via DeepSpeed and FairScale
•
4
published
an
article
about 5 years ago
Article
Porting fairseq wmt19 translation system to transformers
•
1
published
an
article
about 5 years ago
Article
Porting fairseq wmt19 translation system to transformers
•
1