WarpBuild - Notice history

All systems operational

Dashboard - Operational

100% - uptime
May 2024
Jun 2024
Jul 2024

API - Operational

100% - uptime
May 2024
Jun 2024
Jul 2024

GitHub Runners - Operational

100% - uptime
May 2024
Jun 2024
Jul 2024

Docker Builders - Operational

100% - uptime
May 2024
Jun 2024
Jul 2024
Operational

Third Party: Github → Actions - Operational

Third Party: Github → API Requests - Operational

Third Party: Github → Webhooks - Operational

Third Party: Github → Git Operations - Operational

Third Party: Github → Pull Requests - Operational

Notice history

Jul 2024

WarpBuild jobs are seeing delays in start
  • Resolved
    Resolved

    AWS had an issue which was causing capacity issues for WarpBuild instances.

    https://health.aws.amazon.com/health/status#multipleservices-us-east-1_1720795596

    This has now been resolved and we have seen full recovery of all WarpBuild services.

  • Monitoring
    Monitoring

    We're starting to see recovery in the job delays. The backlog should be processed shortly.

  • Update
    Update

    AWS EC2 API has an ongoing incident. This is causing instance capacity to run out.

  • Identified
    Identified
    We are continuing to work on a fix for this incident.
  • Investigating
    Investigating
    We are currently investigating this incident.
Github is not delivering webhooks
  • Resolved
    Resolved
    This incident has been resolved.
  • Identified
    Identified

    We are continuing to monitor Github for a fix - https://www.githubstatus.com/

Jun 2024

No notices reported this month

May 2024

Jobs stuck in queued state
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    GitHub is currently facing an issue with their actions API, where the status of newly created jobs is stuck in the queued state.

Runner delays in getting picked up
  • Resolved
    Resolved

    This incident has been resolved. All pending jobs have been processed.

    Rootcause: Major service disruption to GCP in the America regions across VPC, GKE, and other services.

  • Monitoring
    Monitoring

    The issue is because of a GCP outage. We are seeing recovery now.

  • Investigating
    Investigating

    We are seeing a spike in runner pick up delays. Currently investigating this incident.

Runners experiencing delays
  • Resolved
    Resolved

    This incident has been resolved.

  • Investigating
    Investigating

    There was a Github actions downtime which led to some of WarpBuild runners seeing delays. We are working on a fix.

May 2024 to Jul 2024

Next