WarpBuild - Runners are not allocated or are failing to start – Incident details

Runners are not allocated or are failing to start

Resolved
Major outage
Started about 2 months agoLasted about 1 hour

Affected

Dashboard

Operational from 2:00 PM to 3:20 PM

API

Major outage from 2:00 PM to 3:21 PM

GitHub Runners

Major outage from 2:00 PM to 3:21 PM

Docker Builders

Major outage from 2:00 PM to 3:21 PM

Updates
  • Update
    Update
    This incident has been resolved.
  • Resolved
    Resolved

    This incident has been resolved. A full post-incident report will be published shortly along with mitigation steps.

  • Monitoring
    Monitoring

    We implemented a fix and are currently monitoring the result. Runners are working as usual now.

  • Identified
    Identified

    We are working on a fix for this

  • Investigating
    Investigating

    Runners were either not starting or failing to start with a 503 after allocation.