Corey JamesThe story
The agent runs fixed question sets through the search and compares the answers with a baseline. It reviews how people searched recently and proposes setting changes. It checks that every note taken reached storage. Then it prices the result: what was spent creating each note against what was saved each time one was reused.
The crew
The specialists behind this role, grouped by the kind of work they do.
Keeps knowledge
- Note Queue ReconcilerChecks that every queued note reached storage, flags stragglers past a grace period, and records a summary.Also serves The Institutional Memory
- Search Tuning AnalystReviews recent search behaviour with a language model and proposes setting changes.
- Memory Return-on-Investment ReporterReports the tokens spent creating each note against the tokens saved each time a note is reused or compressed, priced per model provider on per-token or flat-fee plans, and shows project-level totals on a live dashboard.Also serves The Model Broker
Audits and guards
- Search Health ReporterRuns the search quality comparison, the cache gap count and a smoke test, and leaves a short health summary in the team lead's inbox.
- Search Quality AnalystMeasures and tunes search quality.