Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google Cloud Networking, Cloud Load Balancing

Cloud Load Balancing: unable to mage changes into configuration External HTTPS Load Balancer globally

Incident began at 2023-04-26 01:58 and ended at 2023-04-26 04:56 (all times are US/Pacific).

Previously affected location(s)

Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)Turin (europe-west12)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Doha (me-central1)Tel Aviv (me-west1)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)

Date Time Description
27 Apr 2023 10:09 PDT

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support.

(All Times US/Pacific)

Incident Start: 26 April 2023 01:58

Incident End: 26 April 2023 04:56

Duration: 2 hours and 58 minutes

Affected Services and Features:

Google Cloud Load Balancing - Control Plane

Regions/Zones: Global

Description:

Google Cloud Load Balancing customers experienced issues applying configuration updates to their external HTTPS load balancers globally for a duration of 2 hours and 58 minutes.

From preliminary analysis, the root cause of the issue was due to a recent rollout. The issue was fully mitigated on Wednesday, 26 April 2023 04:56 US/Pacific once the rollback and configuration propagation completed.

Customer Impact:

  • Affected customers were unable to make changes to their External HTTPS Load Balancer configuration. Both user interface and gcloud command line interface (CLI) were affected.
26 Apr 2023 05:00 PDT

The issue with Cloud Load Balancing has been resolved for all affected projects as of Wednesday, 2023-04-26 05:00 US/Pacific.

We thank you for your patience while we worked on resolving the issue.
26 Apr 2023 04:40 PDT

Summary: Cloud Load Balancing: unable to mage changes into configuration External HTTPS Load Balancer globally

Description: A mitigation has been applied and we're currently working through the backlog of the impacted projects and the customers should see improvements. We will communicate once the issue has fully been resolved. We do not have an ETA for mitigation at this point.

We will provide more information by Wednesday, 2023-04-26 06:30 US/Pacific.

Diagnosis: Customers will not be able to make changes to their External HTTPS Load Balancer configuration globally. Both user interface and gcloud command line are affected.

Workaround: None at this time.
26 Apr 2023 03:42 PDT

Summary: Cloud Load Balancing: unable to mage changes into configuration External HTTPS Load Balancer globally

Description: Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide more information by Wednesday, 2023-04-26 05:00 US/Pacific.

Diagnosis: Customers will not be able to make changes to their External HTTPS Load Balancer configuration globally. Both user interface and gcloud command line are affected.

Workaround: None at this time.
26 Apr 2023 03:36 PDT

Summary: Cloud Load Balancing: unable to mage changes into configuration External HTTPS Load Balancer globally

Description: We are experiencing an issue with Cloud Load Balancing.

Our engineering team continues to investigate the issue.

We will provide an update by Wednesday, 2023-04-26 04:30 US/Pacific with current details.

Diagnosis: Customers will not be able to make changes to their External HTTPS Load Balancer configuration globally. Both user interface and gcloud command line are affected.

Workaround: None at this time.