Google Cloud Status Dashboard

This page provides status information on the services that are part of Google Cloud Platform. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit cloud.google.com.

Google Kubernetes Engine Incident #19011

We are experiencing an issue with Google Kubernetes Engine.

Incident began at 2019-10-31 16:41 and ended at 2019-11-02 10:00 (all times are US/Pacific).

Date Time Description
Nov 01, 2019 12:42

Our engineers have determined that Google Kubernetes Engine (GKE) was impacted by the same underlying issue as the Google Compute Engine (GCE) incident. The start & end times have been updated in this incident to reflect the approximate impact period. Please refer to https://status.cloud.google.com/incident/compute/19008 for the full impact details of the incident. No further updates will be provided here.

Our engineers have determined that Google Kubernetes Engine (GKE) was impacted by the same underlying issue as the Google Compute Engine (GCE) incident. The start & end times have been updated in this incident to reflect the approximate impact period. Please refer to https://status.cloud.google.com/incident/compute/19008 for the full impact details of the incident. No further updates will be provided here.

Nov 01, 2019 08:53

The issue with creating new Google Kubernetes Engine clusters has been resolved for all affected projects as of Friday, 2019-11-01 08:50 US/Pacific.

We thank you for your patience while we've worked on resolving the issue.

The issue with creating new Google Kubernetes Engine clusters has been resolved for all affected projects as of Friday, 2019-11-01 08:50 US/Pacific.

We thank you for your patience while we've worked on resolving the issue.

Nov 01, 2019 07:17

Description: Mitigation work is currently underway by our engineering team.

We will provide more information by Friday, 2019-11-01 09:00 US/Pacific.

Diagnosis: Cluster creation might fail with NetworkUnavailable status set to True. For existing clusters, new nodes might be created without network routes. As a result, autoscaler might not be able to add capacity to the cluster.

Workaround: None at this time

Description: Mitigation work is currently underway by our engineering team.

We will provide more information by Friday, 2019-11-01 09:00 US/Pacific.

Diagnosis: Cluster creation might fail with NetworkUnavailable status set to True. For existing clusters, new nodes might be created without network routes. As a result, autoscaler might not be able to add capacity to the cluster.

Workaround: None at this time

Nov 01, 2019 05:52

Description: We are experiencing an issue with Google Kubernetes Engine beginning at Thursday, 2019-10-31 17:00 US/Pacific.

Our engineering team continues to investigate the issue.

We will provide an update by Friday, 2019-11-01 07:00 US/Pacific with current details.

Diagnosis: Cluster creation might fail with NetworkUnavailable status set to True. For existing clusters, new nodes might be created without network routes. As a result, autoscaler might not be able to add capacity to the cluster.

Workaround: None at this time

Description: We are experiencing an issue with Google Kubernetes Engine beginning at Thursday, 2019-10-31 17:00 US/Pacific.

Our engineering team continues to investigate the issue.

We will provide an update by Friday, 2019-11-01 07:00 US/Pacific with current details.

Diagnosis: Cluster creation might fail with NetworkUnavailable status set to True. For existing clusters, new nodes might be created without network routes. As a result, autoscaler might not be able to add capacity to the cluster.

Workaround: None at this time

Nov 01, 2019 05:29

Description: We are experiencing an issue with Google Kubernetes Engine beginning at Thursday, 2019-10-31 17:00 US/Pacific.

Our engineering team continues to investigate the issue.

We will provide an update by Friday, 2019-11-01 06:00 US/Pacific with current details.

Diagnosis: Cluster creation might fail with NetworkUnavailable status set to True. For existing clusters, adding a new node might fail. Autoscaler might not be able to increase the number of nodes.

Workaround: None at this time

Description: We are experiencing an issue with Google Kubernetes Engine beginning at Thursday, 2019-10-31 17:00 US/Pacific.

Our engineering team continues to investigate the issue.

We will provide an update by Friday, 2019-11-01 06:00 US/Pacific with current details.

Diagnosis: Cluster creation might fail with NetworkUnavailable status set to True. For existing clusters, adding a new node might fail. Autoscaler might not be able to increase the number of nodes.

Workaround: None at this time