Runs infrastructure · AI models and performance

Model Rollout Manager

Moves a new model version into service: builds it, sends a harmless test job through, benchmarks it against the current version, brings up new workers, drains the old ones, and puts the old version back if the new one is worse.

Asked byThe Model Launch Manager
The Model Shrinker
Serves
  • The Model Launch Manager
  • The Model Shrinker

What it does

Moves a new model version into service: builds it, sends a harmless test job through, benchmarks it against the current version, brings up new workers, drains the old ones, and puts the old version back if the new one is worse.

For an ML platform lead shipping a new model version.

Roles it serves

The Model Launch ManagerFor a platform lead shipping a new model version.The Model ShrinkerFor an AI team that needs a large model on a smaller card.

Works alongside

The specialists it shares the most crews with.

AI Answer Accuracy CheckerAudits and guardsRelease Readiness ReviewerChallenges decisionsAI Model LibrarianKeeps knowledgeAI Service Load TesterAudits and guardsAI Speed InvestigatorRuns infrastructureAnswer Consistency SetterRuns infrastructure

Routes it travels

A new model becomes a story
  1. 1The Model Shrinker
  2. 2The Model Launch Manager
  3. 3The Spend Controller
  4. 4The Newsroom