sgugger (Sylvain Gugger)

published an article almost 2 years ago

Article

Fine-tuning Llama 2 70B using PyTorch FSDP

By

and 3 others •

Sep 13, 2023

• 27

published an article about 2 years ago

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

By

and 4 others •

May 24, 2023

• 161

published an article about 2 years ago

Article

Introducing RWKV — An RNN with the advantages of a transformer

By

and 3 others •

May 15, 2023

• 22

published an article almost 3 years ago

Article

How 🤗 Accelerate runs very large models thanks to PyTorch

By

•

Sep 27, 2022

• 12

published an article almost 3 years ago

Article

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

By

and 1 other •

Sep 16, 2022

• 1

published an article about 3 years ago

Article

Accelerate Large Model Training using DeepSpeed

By

and 1 other •

Jun 28, 2022

• 6

published an article about 3 years ago

Article

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

By

and 1 other •

May 2, 2022

• 5

published an article almost 4 years ago

Article

Course Launch Community Event

By

•

Oct 26, 2021

• 3

published an article over 4 years ago

Article

Introducing 🤗 Accelerate

By

•

Apr 16, 2021

• 3

Sylvain Gugger

AI & ML interests

Organizations

Fine-tuning Llama 2 70B using PyTorch FSDP

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Introducing RWKV — An RNN with the advantages of a transformer

How 🤗 Accelerate runs very large models thanks to PyTorch

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

Accelerate Large Model Training using DeepSpeed

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

Course Launch Community Event

Introducing 🤗 Accelerate

Sylvain Gugger

AI & ML interests

Organizations

sgugger's activity

Fine-tuning Llama 2 70B using PyTorch FSDP

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

Introducing RWKV — An RNN with the advantages of a transformer

How 🤗 Accelerate runs very large models thanks to PyTorch

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

Accelerate Large Model Training using DeepSpeed

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

Course Launch Community Event

Introducing 🤗 Accelerate