AI and model teams

The Model Broker

For an AI team lead paying several model providers.

One signal · 7 specialists · one result
How the work moves

Four steps, each done by one specialist

the signalthe resultEach step is done by one specialist on the crew

The story

Every model call from every agent passes through one switchboard. The agent sends each call to an approved provider, keeps each provider inside its rate limit and steps down to a cheaper tier when a quota runs out. Commercial AI assistants that want access are registered, and a person approves each grant. Every call is charged to the task that made it.

The crew

The specialists behind this role, grouped by the kind of work they do.

Audits and guards
  • AI Access DeskRegisters each AI assistant as an app, holds every grant until a person approves it, accepts sign-in tokens from your own server and from your workplace platform, shows each assistant only the tools it is allowed, and ties every action to the assignment rather than to what the assistant claims.Also serves The Security Officer, The Assistant-Ready Website
  • Engineering Cost AnalystAttributes every model call to the task, role and phase that spent it and turns the totals into cost and human-equivalent effort hours per project.Also serves The Spend Controller
Runs infrastructure
  • AI Provider SwitchboardSends every agent's model calls to an approved provider, keeps each provider inside its rate limit, steps down to a cheaper tier when a quota runs out, and blocks traffic that a provider's terms do not allow.Also serves The Spend Controller
  • Model Comparison EvaluatorThis agent puts two or three model versions through the same hidden test set, runs any generated code safely, scores the answers strictly and explains where each version fails.Also serves The Model Launch Manager
Keeps knowledge
Speaks to people

Where this crew also works

Each bar counts the specialists this role shares with another.

The engineering behind this role