The story
Every large run leaves data behind, and the agent looks after it. It checks a finished run against the original request and reports whether every item is present. Stored files are re-checked for damage. When a new version of the data is built, the agent switches readers to it and keeps the previous one until the new one has been confirmed. If storage fails, it reports what was affected and what was recovered.
The crew
The specialists behind this role, grouped by the kind of work they do.
Runs infrastructure
- Data Version PromoterSwitches readers to a newly built version of stored data, finishes a build that stalled and cancels one that went wrong.Also serves The Safe Change Desk
- Storage Spend ReconcilerIt syncs the day's storage cost into the daily budget so tomorrow's limit reflects real spend.Also serves The Spend Controller
- Storage Incident HandlerWhen storage reports a problem, this agent reads the recovery report, runs a consistency check, sends lost items back for reprocessing and records the sign-off.Also serves The Research Lab
Keeps knowledge
- Research Data ArchivistThis agent manages stored research data by version: it lists what is stored, closes and activates versions, releases checkpoints and clears out old versions.Also serves The Research Lab
- Run Conditions RecorderThis agent records GPU memory and machine load around every run so results are read against the conditions they ran in.Also serves The Speed Detective
Audits and guards
- Run Verification ClerkChecks a finished run against its original request and reports whether every item is present, without running anything again.Also serves The Bulk Run Manager
- Stored Data Integrity CheckerRe-checks that each stored data file is intact and correctly laid out, and reports any file that fails.Also serves The Database Guard
Where this crew also works
The engineering behind this role
GPU vector search and corpus analyticsCapabilityHigh-throughput batch inference and embeddingsCapabilityAppend-only, with tombstones and lineageIdeaThree shards that move togetherEngineering storyMillions of queued items that were not thereEngineering storyAll capabilitiesThe engineering, by what it does