LLM Course documentation
Coming soon…
0. Setup
1. Transformer models
2. Using 🤗 Transformers
3. Fine-tuning a pretrained model
4. Sharing models and tokenizers
5. The 🤗 Datasets library
6. The 🤗 Tokenizers library
7. Classical NLP tasks
8. How to ask for help
9. Building and sharing demos
10. Curate high-quality datasets
11. Fine-tune Large Language Models
12. Build Reasoning Models new
IntroductionReinforcement Learning on LLMsThe Aha Moment in the DeepSeek R1 PaperAdvanced Understanding of GRPO in DeepSeekMathImplementing GRPO in TRLPractical Exercise to Fine-tune a model with GRPOPractical Exercise with UnslothComing soon...
Course Events
Coming soon…
This chapter is being run as a live cohort now! If you’ve finished the material so far, here’s what to expect:
Course Schedule
| Date | Unit |
|---|---|
| ~March 7th, 2025~ | ~No-Code Exam and Certification~ |
| ~March 14th, 2025~ | ~Next Practical Exercise~ |
| March 21st, 2025 | Interactive code review |
| April 2025 | More written material on building reasoning models |
| April 2025 | Live sessions on building Open R1 |
| April 2025 | Code Exam and Certification |
Staying Up to Date
If you want to follow the course, follow the The Reasoning Course and join the Discord community!
Update on GitHub