Service Health
-
-
-
-
Incident affecting Google Kubernetes Engine
We are experiencing an issue with Google Kubernetes Engine in us-central1.
Incident began at 2020-10-19 17:42 and ended at 2020-10-19 20:56 (all times are US/Pacific).
| Date | Time | Description | |
|---|---|---|---|
| | 19 Oct 2020 | 20:56 PDT | The issue with Google Kubernetes Engine has been resolved for all affected projects as of Monday, 2020-10-19 20:00 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| | 19 Oct 2020 | 19:59 PDT | Description: Our engineering team continues to work on mitigating the underlying networking issue. We will provide an update by Monday, 2020-10-19 21:15 US/Pacific with current details. Diagnosis: Cluster mutation operations may result errors for affected clusters. The operations include creations and deletions of clusters, nodepools, and nodes. Workaround: None at this time. |
| | 19 Oct 2020 | 19:06 PDT | Description: Our engineering team has determined that further investigation is required to mitigate the underlying networking issue. We will provide an update by Monday, 2020-10-19 20:05 US/Pacific with current details. Diagnosis: Affected clusters may fail during cluster mutation operations, including creations and deletions of clusters, nodepools, and nodes. Workaround: None at this time. |
| | 19 Oct 2020 | 18:38 PDT | Description: Mitigation work is still underway in the underlying networking incident. We believe that cluster mutation operations will be recovered shortly after the underlying incident is mitigated. We will provide more information by Monday, 2020-10-19 19:15 US/Pacific. Diagnosis: Affected clusters may fail during cluster mutation operations, including creations and deletions of clusters, nodepools, and nodes. Workaround: None at this time. |
| | 19 Oct 2020 | 18:05 PDT | Description: Mitigation work is still underway by our engineering team. We believe that the mitigation of the underlying networking incident will resolve its affect to cluster mutation operations. We do not yet have a ETA of full mitigation at this point. We will provide more information by Monday, 2020-10-19 18:45 US/Pacific. Diagnosis: Affected clusters may fail during cluster mutation operations, including creations and deletions of clusters, nodepools, and nodes. Workaround: None at this time. |
| | 19 Oct 2020 | 17:44 PDT | Description: We are experiencing an issue with Google Kubernetes Engine in the us-central1 region. We believe the cause is related to the currently ongoing networking incident in the region. Our engineering team continues to investigate the issue. We will provide an update by Monday, 2020-10-19 18:15 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Affected clusters may fail during cluster mutation operations, including creations and deletions of clusters, nodepools, and nodes. Workaround: None at this time. |
- All times are US/Pacific