deco - Outage of some sites (k8s infra) – Incident details

Third Party: Supabase → Storage experiencing partial outage

Outage of some sites (k8s infra)

Resolved
Partial outage
Started over 1 year agoLasted about 1 hour

Affected

hosting-kubernetes

Partial outage from 10:30 AM to 11:24 AM

Updates
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring

    We disable one layer of cache, and are monitoring sites going back.

  • Identified
    UTC
    Identified

    One layer of our tiered cache strategy had a bottleneck on connections/usage.

  • Investigating
    UTC
    Investigating
    We are currently investigating this incident.