Service Health
Incident affecting Google Cloud Networking, Google Compute Engine, Cloud Spanner, Google Cloud Pub/Sub, Hybrid Connectivity
We've been informed that Cloud Networking, and Load Balancer, are not functioning in europe-west2
Incident began at 2021-08-06 01:56 and ended at 2021-08-06 05:41 (all times are US/Pacific).
Date | Time | Description | |
---|---|---|---|
| 6 Aug 2021 | 11:56 PDT | We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Support by opening a case using https://cloud.google.com/support (All Times US/Pacific) Incident Timeline: 06 August 2021 01:56 - 03:23 06 August 2021 05:27 - 05:41 Duration: 1 hours, 41 minutes Affected Services and Features: Google Cloud Networking, Cloud Load Balancing, Compute Engine, Cloud Spanner, Pub/Sub, Cloud Interconnect Regions/Zones: europe-west2-a Description: Google Cloud Networking and Google Cloud Load Balancing (GCLB) experienced elevated packet loss in europe-west2-a. From preliminary analysis, the root cause of the issue is a configuration change on a device that caused a permission issue with an automatic configuration deployment and failed to propagate. This resulted in a corrupted configuration which caused traffic to be dropped. Customer Impact: Customers experienced elevated packet loss or connection terminations for connections in europe-west2-a. A small number of Compute Engine instances failed to start in europe-west2-a. Cloud Interconnect in europe-west2 observed an increase in packet loss. Cloud Spanner requests passing through europe-west2-a experienced increased error rates. Cloud Pub/Sub may have experienced increased error rates when publishing to topics in europe-west2-a. |
| 6 Aug 2021 | 04:31 PDT | The issue with Cloud Networking / Load Balancing has been resolved for all affected users as of Friday, 2021-08-06 03:22 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| 6 Aug 2021 | 03:59 PDT | Summary: We've been informed that Cloud Networking, and Load Balancer, are not functioning in europe-west2 Description: Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Friday, 2021-08-06 04:36 US/Pacific. Diagnosis: None at this time. Workaround: None at this time. |
| 6 Aug 2021 | 03:00 PDT | Summary: We've been informed that Cloud Networking, and Load Balancer, are not functioning in europe-west2 Description: We are investigating a potential issue with Cloud Networking and/or Load Balancing in europe-west2. We will provide more information by Friday, 2021-08-06 04:00 US/Pacific. Diagnosis: None at this time. Workaround: None at this time. |
- All times are US/Pacific