Runs infrastructure · Machines, data and operations

Capacity Planner

Reads how fast each card runs, how full the queues and the database are, what is running now and what spot GPUs cost, then proposes where the next workload should go and whether renting is worth it.

Asked byThe Model Launch Manager
The Bulk Run Manager
Serves
  • The Model Launch Manager
  • The Bulk Run Manager

What it does

Reads how fast each card runs, how full the queues and the database are, what is running now and what spot GPUs cost, then proposes where the next workload should go and whether renting is worth it.

For an infrastructure lead deciding what to buy or rent.

Roles it serves

The Model Launch ManagerFor a platform lead shipping a new model version.The Bulk Run ManagerFor a team with millions of prompts to process.

Works alongside

The specialists it shares the most crews with.

AI Answer Accuracy CheckerAudits and guardsAI Model LibrarianKeeps knowledgeAI Service Load TesterAudits and guardsAI Speed InvestigatorRuns infrastructureAnswer Consistency SetterRuns infrastructureBulk Inference Run ManagerRuns infrastructure

Routes it travels

A new model becomes a story
  1. 1The Model Shrinker
  2. 2The Model Launch Manager
  3. 3The Spend Controller
  4. 4The Newsroom