AWS Cluster DNS Changes Degraded Performance

Affected components

Update timeline

1. resolvedMay 7, 2026, 10:15 PM

   DNS updates for ACME are confirmed healthy. Cluster updates are now proceeding as expected.

2. monitoringMay 7, 2026, 07:47 PM

   We are continuing to monitor for any further issues.

3. monitoringMay 7, 2026, 07:47 PM

   We've identified a bad piece of metadata causing DNS issues. We've since patched this metadata and are seeing recovery in ACME updates for cluster topology changes. We will continue to monitor recovery.

4. investigatingMay 7, 2026, 05:50 PM

   We are still seeing cases where new cluster update requests are failing to go through due to ACME related DNS issues. We are actively investigating this issue.

5. identifiedMay 7, 2026, 04:58 PM

   Mitigation is in progress; recovery for DNS operations and downstream cluster topology changes has begun.

6. identifiedMay 7, 2026, 03:20 PM

   DNS changes for AWS clusters are currently degraded. Cluster topology modifications may be delayed or not able to complete successfully. We've identified the issue and are pushing out a patch.

7. identifiedMay 7, 2026, 03:17 PM

   DNS changes for AWS clusters are currently degraded. We've identified the issue and are pushing out a patch.