The story
The agent takes stock of each machine: memory, model files and idle capacity. It builds the engine for each processor type, runs the tests and measures throughput with the results saved. Where a small helper model shares a card with a large one, it lets requests in only when there is measured room and tells the rest when to try again.
The crew
The specialists behind this role, grouped by the kind of work they do.
Runs infrastructure
- Performance Benchmark AnalystRuns the same fixed benchmark set on every change, reports the same four numbers each time, ramps concurrent users until a stop condition is hit, and says plainly whether the change helped.Also serves The Model Shrinker
- Model Serving EngineerBuilds a version of the model sized for each GPU card you own, measures how fast each card runs it, sets each card's limits for the scheduler, and copies the right build to every machine.Also serves The Model Launch Manager
- GPU Capacity Inventory ClerkThis agent takes stock of memory, model weights and idle capacity on each machine and rolls it up into one picture for planning.Also serves The Watch Office
- GPU Server OnboarderThis agent prepares a newly built AI engine to take work from the shared queue by writing and checking the settings files it needs.Also serves The Branch Office Engineer
- GPU ProfilerThis agent profiles the AI engine at system, chip and memory level, finds idle time under steady load and records GPU use.Also serves The Speed Detective
- Model CourierCopies each new model build to the remote machines that serve it and confirms every copy arrived complete.Also serves The Branch Office Engineer
- AI Engine Build and Benchmark AgentThis agent builds the engine for each GPU type, runs its tests and measures throughput with saved results.
Does the work
- Release EngineerScreens each candidate change for benchmark gaming, builds release images from pinned inputs, checks every hash, compares the candidate with the current baseline and promotes it, then tells the other teams to rebase.Also serves The Software Department
Keeps knowledge
- Porting Pattern ScoutFinds how a reference library or specification solves a problem and where the team's own code would host the equivalent.Also serves The Migration Planner