Self-Compacting Language Model Agents
Apple researchers propose SELFCOMPACT, a way for language model agents to decide for themselves when to compress their long traces of reasoning and tool calls. Current scaffolds compact at a fixed token threshold, which can throw away partial results in the middle of a task.