deco - Notice history

All systems operational

hosting-kubernets - Operational

100% - uptime
Feb 2025 · 99.99%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

hosting-denodeploy - Operational

admin - Operational

100% - uptime
Feb 2025 · 100.0%Mar · 99.99%Apr · 99.83%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

VTEX - Operational

Third Party: Amazon Web Services (AWS) → AWS ec2-sa-east-1 - Operational

Third Party: Cloudflare → Cloudflare Sites and Services → API - Degraded performance

Third Party: Cloudflare → Cloudflare Sites and Services → CDN/Cache - Operational

Third Party: Cloudflare → Cloudflare Sites and Services → DNS Root Servers - Operational

Third Party: Cloudflare → Cloudflare Sites and Services → SSL Certificate Provisioning - Operational

Third Party: Cloudflare → Cloudflare Sites and Services → Workers - Operational

Third Party: Fly.io → AWS s3-sa-east-1 - Operational

Third Party: Fly.io → Application Hosting → GRU - São Paulo, Brazil - Operational

Third Party: Github → Actions - Operational

Third Party: Github → API Requests - Operational

Third Party: Github → Git Operations - Operational

Third Party: Github → Pull Requests - Operational

Third Party: Github → Webhooks - Operational

Third Party: Shopify → Shopify API & Mobile - Operational

Third Party: Shopify → Shopify Checkout - Operational

Third Party: Shopify → Shopify Point of Sale - Operational

Third Party: Supabase → Supabase Cloud → AWS ec2-sa-east-1 - Operational

Third Party: Discord → Voice → Brazil - Operational

Third Party: Supabase → Auth - Operational

Third Party: Supabase → Storage - Operational

Notice history

Apr 2025

Admin.cx fails to complete some tasks
  • Resolved
    Resolved

    This incident has been resolved.

    We apologize for the inconvenience and are working to prevent this type of problem in the future.

  • Update
    Update

    We are continuing to work on a fix for this incident.

    Our nginx is still suffering due to excess of routes/endpoints.

  • Identified
    Identified

    Our nginx that responds requests for environments is overloaded. We are escalating the service to improve our SLA.

    Due to this failure, operations related to admin operations on envs are failing.

    This doesn't impact production sites.

  • Investigating
    Investigating
    We are currently investigating this incident.

Mar 2025

Users Unable to Access deco.cx Admin Due to Permission Changes
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Investigating
    Investigating
    We are currently investigating this incident.

Feb 2025

Some sites on k8 infrastructure are currently down
  • Resolved
    Resolved

    Some sites reported slowness from 9:20 to 9:39 (timeout requests increased from 600 to 1.6k) requests (0.8% to 2.3%).

    We rolled back some configuration.

  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Identified
    Identified

    A change on our network configuration dropped packages from some origins.

502 (bad gateway) from deno deploy infrastructure
  • Resolved
    Resolved

    Deno deploy isolates were killed due to memory starvation.

    A new memory profile was applied, thus resolving this issue.

  • Update
    Update

    Deno deploy added capacity to mitigate reported issues.

    Still investigating root cause.

    We are back to normal status rate.

  • Investigating
    Investigating
    We are currently investigating this incident.

Feb 2025 to Apr 2025

Next