Finetuning Sessions – Week 2 Office Hours

Here's the recording from yesterday's live session, covering the Week 2 content of the Finetuning Sessions.

During office hours, we focused on:

• The foundations of Supervised Finetuning (SFT)

• Chat templates, with a deep dive into the Qwen3 template

• Reasoning models and why they require an SFT step before applying RL

• Synthetic dataset generation

• Agentic SFT, in…