Agentics: Memorizing Session Transcripts Isn't Useful
- 31 likes may not seem like a lot, but that's actually everyone on substack notesWe have found zero performance benefit on SWE tasks when agents have search access to their previous transcript sessions, provided they have access to other forms of context.
- We also have not found much benefit in trying to automatically trawl through session transcripts to improve agent context, unless there is a human in the loop.
- Intuitively it feels like there's a lot of valuable information in a transcript between an agent and an engineer.
Unverified
- 31 likes may not seem like a lot, but that's actually everyone on substack notesWe have found zero performance benefit on SWE tasks when agents have search access to their previous transcript sessions, provided they have access to other forms of context.
- We also have not found much benefit in trying to automatically trawl through session transcripts to improve agent context, unless there is a human in the loop.
- Intuitively it feels like there's a lot of valuable information in a transcript between an agent and an engineer.
Sources: 12gramsofcarbon