You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Our current contextStrategy: 'summarize' compresses the entire conversation history into a single summary. This is a blunt instrument — it loses tool call decisions, action sequences, and key reasoning while retaining generic summaries.
Industry comparison: Anthropic's Compaction API and ACON framework use selective compression — preserve decisions and action outcomes, discard intermediate reasoning and raw tool outputs. This achieves better compression ratios with higher fidelity.
Proposal
Upgrade the summarize strategy to a compaction-style approach:
Preserve: tool call decisions (which tool, why), final outcomes, errors encountered, key user instructions
Discard: thinking/reasoning blocks, raw tool output (replace with one-line summary), redundant assistant acknowledgments
Structure: output as a structured context block (not free-form prose) so the model can parse it reliably
This could be implemented as:
A new contextStrategy: 'compact' option alongside the existing summarize
Or an upgrade to the existing summarize with a smarter default prompt
Problem
Our current
contextStrategy: 'summarize'compresses the entire conversation history into a single summary. This is a blunt instrument — it loses tool call decisions, action sequences, and key reasoning while retaining generic summaries.Industry comparison: Anthropic's Compaction API and ACON framework use selective compression — preserve decisions and action outcomes, discard intermediate reasoning and raw tool outputs. This achieves better compression ratios with higher fidelity.
Proposal
Upgrade the summarize strategy to a compaction-style approach:
This could be implemented as:
contextStrategy: 'compact'option alongside the existingsummarizesummarizewith a smarter default promptSource