Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google Cloud Networking, Cloud Load Balancing

We are experiencing Cloud Networking Control Plane issues

Incident began at 2022-04-26 01:47 and ended at 2022-04-26 02:40 (all times are US/Pacific).

Previously affected location(s)

Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Belgium (europe-west1)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)

Date Time Description
26 Apr 2022 10:23 PDT

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Support by opening a case https://cloud.google.com/support or help article https://support.google.com/a/answer/1047213.

(All Times US/Pacific)

Incident Start: 26 April 2022 01:47

Incident End: 26 April 2022 02:40

Duration: 53 minutes

Affected Services and Features: Google Cloud Networking

Regions/Zones: Global/All regions

Description:

Google Cloud Networking control plane experienced elevated latency. All Google Cloud Load Balancer config to Google Front End stalled globally for a duration of 53 minutes.From the preliminary analysis, the root cause of the issue seems to be a race condition where unprocessed configuration deletes caused conflicts with newer configuration changes, leading to the configuration pipeline stall.

Customer Impact:

Customers might have experienced issues while creating new forwarding rules for Global Layer 7 External load balancer or edit or delete existing ones.
26 Apr 2022 02:52 PDT

The issue with Google Cloud Networking has been resolved for all affected users as of Tuesday, 2022-04-26 02:40 US/Pacific.

We thank you for your patience while we worked on resolving the issue.
26 Apr 2022 02:32 PDT

Summary: We are experiencing Cloud Networking Control Plane issues

Description: We are experiencing an issue with Google Cloud Networking beginning at Tuesday, 2022-04-26 02:06 US/Pacific.

Our engineering team continues to investigate the issue.

We will provide an update by Tuesday, 2022-04-26 03:00 US/Pacific with current details.

We apologize to all who are affected by the disruption.

Diagnosis: None at this time.

Workaround: None at this time.