Runs infrastructure · Machines, data and operations

Data Job Builder

Generates the full skeleton of a new processing job so the only thing left to write is the business logic, checks that it builds, waits for a person to approve the restart, runs a harmless test job through it, and opens a merge request.

Asked byThe Automation Builder
The Pipeline Foreman
Serves
  • The Automation Builder
  • The Pipeline Foreman

What it does

Generates the full skeleton of a new processing job so the only thing left to write is the business logic, checks that it builds, waits for a person to approve the restart, runs a harmless test job through it, and opens a merge request.

For an engineering manager who needs a new data-processing job.

Roles it serves

The Automation BuilderFor a manager with recurring jobs done by hand.The Pipeline ForemanFor a data team lead who needs a new processing job by Thursday.

Works alongside

The specialists it shares the most crews with.

Internal Automation BuilderDoes the workJob DispatcherRuns infrastructureSelf-Starting Job SchedulerRuns infrastructureService Function BuilderRuns infrastructureAcceptance TesterAudits and guardsAutomation Library CaretakerDoes the work