WarpBuild - Runners are not allocated or are failing to start – Incident details

Third Party: Cloudflare → Cloudflare Sites and Services → R2 experiencing partial outage

Runners are not allocated or are failing to start

Resolved
Major outage
Started 8 months agoLasted about 1 hour

Affected

Dashboard

Operational from 2:00 PM to 3:20 PM

API

Major outage from 2:00 PM to 3:21 PM

GitHub Runners

Major outage from 2:00 PM to 3:21 PM

Docker Builders

Major outage from 2:00 PM to 3:21 PM

Updates
  • Update
    UTC
    Update
    This incident has been resolved.
  • Resolved
    UTC
    Resolved

    This incident has been resolved. A full post-incident report will be published shortly along with mitigation steps.

  • Monitoring
    UTC
    Monitoring

    We implemented a fix and are currently monitoring the result. Runners are working as usual now.

  • Identified
    UTC
    Identified

    We are working on a fix for this

  • Investigating
    UTC
    Investigating

    Runners were either not starting or failing to start with a 503 after allocation.