Corey JamesThe story
The agent questions a model at scale, organises what comes back into a structured knowledge base and audits it for gaps and errors. The same pipeline produces training data for a smaller model.
The crew
The specialists behind this role, grouped by the kind of work they do.
Does the work
- AI Model Study RunnerThis agent prepares large sets of test questions, runs them through a model in one repeatable batch, follows progress, retries failures and stores the results for study.
- Training Data ProducerIt writes prompts designed to draw out a model's behaviour, runs resumable collection jobs across graphics servers, and stores what it collects for training, with status and replay.Also serves The Research Lab
- Model Insight ExtractorGenerates a large set of test prompts, runs them through the model, captures the model's internal state for each prompt, and re-runs any that failed.Also serves The Research Lab
Audits and guards
- Knowledge Base AuditorThis agent checks that the knowledge base still lines up with its reference material and lists missing or incomplete topics for repair.
- Knowledge Base Health AnalystThis agent scores every topic on dozens of health measures and reports which topics need more depth or rebalancing.Also serves The Knowledge Gardener
- Knowledge Entry ScreenerTests each proposed entry against the existing topics and records an accept, hold or reject decision with the measurement behind it.Also serves The Knowledge Gardener
Keeps knowledge
- Knowledge Base BuilderThis agent questions an AI model topic by topic, finds the thin areas, proposes new entries, keeps only the ones that pass a quality bar, and deepens weak topics until the knowledge base is full.
- Knowledge Base MaintainerThis agent runs the regular upkeep jobs: screening new entries, rebalancing between related topics, refreshing embeddings and rebuilding the search index.Also serves The Knowledge Gardener
- Vector Library CuratorKeeps a large searchable collection healthy: it embeds new material, rebuilds and checks the search indexes, scores how well each topic cluster hangs together on the GPU, accepts or rejects new clusters, rebalances crowded ones, and retires stale index files.Also serves The Knowledge Gardener
- Knowledge Base CuratorIt finds the thin areas of the knowledge base, writes candidate entries, admits only those that fit the existing topics, labels and rebalances the topics, and reports which areas need repair.
Runs infrastructure
- Search Index ManagerThis agent counts, builds, checks and reports on the search indexes behind semantic search.Also serves The Search Keeper