deco - Admin.cx fails to complete some tasks – Incident details

Admin.cx fails to complete some tasks

Resolved
Partial outage
Started 9 days agoLasted about 4 hours

Affected

admin

Partial outage from 6:13 PM to 10:20 PM

Updates
  • Resolved
    Resolved

    This incident has been resolved.

    We apologize for the inconvenience and are working to prevent this type of problem in the future.

  • Update
    Update

    We are continuing to work on a fix for this incident.

    Our nginx is still suffering due to excess of routes/endpoints.

  • Identified
    Identified

    Our nginx that responds requests for environments is overloaded. We are escalating the service to improve our SLA.

    Due to this failure, operations related to admin operations on envs are failing.

    This doesn't impact production sites.

  • Investigating
    Investigating
    We are currently investigating this incident.