Article
GaLore: Advancing Large Model Training on Consumer-grade Hardware
- +7
Titus-von-Koeller, jiaweizhao, mdouglas, hiyouga, ybelkada, muellerzr, amyeroberts, smangrul, BenjaminB
• • 32Sourab Mangrulkar
smangrul
AI & ML interests
Machine Learning, Deep Learning, Natural Language Processing, Natural Language Generation, Computer Vision, Reinforcement Learning
Recent Activity
upvoted a collection 2 months ago
NVIDIA Nemotron v3 liked a model 3 months ago
Qwen/Qwen3.5-2B liked a model 3 months ago
Qwen/Qwen3-VL-2B-InstructOrganizations
published an article about 2 years ago
published an article over 2 years ago
Article
🤗 PEFT welcomes new merging methods
smangrul, sayakpaul
• • 30 published an article over 2 years ago
Article
Mixture of Experts Explained
- +4
osanseviero, lewtun, philschmid, smangrul, ybelkada, pcuenq
• • 1.13k published an article over 2 years ago
Article
Personal Copilot: Train Your Own Coding Assistant
smangrul, sayakpaul
• • 79 published an article over 2 years ago
Article
Fine-tuning Llama 2 70B using PyTorch FSDP
- +2
smangrul, sgugger, lewtun, philschmid
• • 32 published an article almost 3 years ago
Article
The Falcon has landed in the Hugging Face ecosystem
- +6
lvwerra, ybelkada, smangrul, lewtun, olivierdehaene, pcuenq, philschmid, osanseviero
• • 17 published an article almost 3 years ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
- +3
ybelkada, timdettmers, artidoro, sgugger, smangrul
• • 180 published an article about 3 years ago
Article
Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU
- +4
edbeeching, ybelkada, lvwerra, smangrul, lewtun, kashif
• • 72 published an article over 3 years ago
Article
Parameter-Efficient Fine-Tuning using 🤗 PEFT
smangrul, sayakpaul
• • 119 published an article over 3 years ago
Article
Parameter-Efficient Fine-Tuning using 🤗 PEFT
smangrul, sayakpaul
• • 119 published an article almost 4 years ago
Article
Accelerate Large Model Training using DeepSpeed
smangrul, sgugger
• • 7 published an article about 4 years ago
Article
Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel
smangrul, sgugger
• • 9 published an article about 4 years ago
Article
Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel
smangrul, sgugger
• • 9