Service Health
Incident affecting Cloud Armor, Google Cloud Networking
We are experiencing an issue with Cloud Armor control plane
Incident began at 2022-06-11 05:16 and ended at 2022-06-11 07:45 (all times are US/Pacific).
Previously affected location(s)
Global
Date | Time | Description | |
---|---|---|---|
| 13 Jun 2022 | 13:33 PDT | We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Support by opening a case https://cloud.google.com/support or help article https://support.google.com/a/answer/1047213. (All Times US/Pacific) Incident Start: 11 June 2022 05:16 Incident End: 11 June 2022 07:45 Duration: 2 hours, 29 minutes Affected Services and Features: Google Cloud Armour Regions/Zones: Global Description: Google Cloud Armor control plane was not processing updates in the global locale for a duration of 2 hours and 29 minutes. From preliminary analysis, the root cause of the issue appears to be multiple Storage errors that caused the control plane writer to stop updating. The control plane processed no or minimal updates within 2022-06-11 05:16 - 07:45 PDT. Customer Impact: Customers may have experienced Cloud Armor rule changes that were not applied since the control plane was not processing changes. |
| 11 Jun 2022 | 08:44 PDT | The issue with Cloud Armor has been resolved for all affected users as of Saturday, 2022-06-11 07:45 US/Pacific. Customers who made updates during the timeframe of 2022-06-11 05:16 - 07:45 PDT are not effective and will need to make a fresh update to their Cloud Armor config. We thank you for your patience while we worked on resolving the issue. |
| 11 Jun 2022 | 07:22 PDT | Summary: We are experiencing an issue with Cloud Armor control plane Description: We are experiencing an issue with Cloud Armor beginning at Saturday, 2022-06-11 05:27 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Saturday, 2022-06-11 08:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers may experience that Cloud Armor control plane is stuck with no updates. Workaround: None at this time. |
| 11 Jun 2022 | 06:46 PDT | Summary: We are experiencing an issue with Cloud Armor control plane Description: We are experiencing an issue with Cloud Armor beginning at Saturday, 2022-06-11 05:27 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Saturday, 2022-06-11 07:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers may experience that Cloud Armor control plane is stuck with no updates. Workaround: None at this time. |
- All times are US/Pacific