Discussion about this post

User's avatar
Hellospark's avatar

Plain-English version for anyone who hasn't hit this yet: when a session gets too long, most agent tools compact it with another model call that summarizes it, and that summary is where details get lost. The fix we'd copy first is the recall one. Dump the important tool results to files and keep a table of contents to the old conversation, so a detail that missed the summary can still be looked up. Has anyone compared the running-notebook approach against the summary call on their own evals?

Ready for more?