deco - Sites down on K8S with no healthy upstream message – Incident details

Third Party: Supabase → Storage experiencing partial outage

Sites down on K8S with no healthy upstream message

Resolved
Partial outage
Started almost 2 years agoLasted 10 minutes

Affected

hosting-kubernetes

Partial outage from 11:44 AM to 11:51 AM, Degraded performance from 11:51 AM to 11:54 AM

Updates
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Identified
    UTC
    Identified

    We changed our router table on k8s but didn't restart our nodes.

    We rollback our changes to recover network communication.

  • Investigating
    UTC
    Investigating
    We are currently investigating this incident.