Finetuning Sessions – Week 3 Office Hours

Playback speed

Share post at current time

0:00

The full episode is only available to paid subscribers of The Neural Maze

Covering LoRA, the research trick that became the industry standard

Mar 02, 2026

∙ Paid

Here's the recording from yesterday's live session, covering the Week 3 content of the Finetuning Sessions.

During office hours, we focused on:

The intuition behind LoRA (Low-Rank Adaptation) and why it works
Why LoRA became the industry standard for efficient finetuning
The tradeoffs compared to full finetuning (cost, performance, flexibility)
The most impo…

Continue reading this post for free, courtesy of Miguel Otero Pedrido.