Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Media CDN, Google Cloud Networking

Media CDN is experiencing issues with configuration changes

Incident began at 2023-07-10 09:38 and ended at 2023-07-10 11:28 (all times are US/Pacific).

Previously affected location(s)

Global

Date Time Description
11 Jul 2023 09:10 PDT

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support

(All Times US/Pacific)

Incident Start: 10 July 2023 at 9:38

Incident End: 10 July 2023 at 11:28

Duration: 1 hour, 50 minutes

Affected Services and Features:

Media CDN

Regions/Zones: Global

Description:

The Google Cloud Media CDN management API produced errors or time outs for 1 hour and 50 minutes for all configuration changes. The management plane produced errors globally in all regions. From preliminary analysis, the root cause of the issue is a configuration change for a dependency that Media CDN uses to push customer configuration changes from the management API to the Media CDN data plane.

Google engineers were alerted to the problem by automated monitoring tools and fixed the issue by excluding Media CDN's pushes from the configuration change in the dependency and restarting the dependency's tasks that required this new configuration change.

Customer Impact:

Customers would have been unable to reconfigure their Media CDN EdgeCache resources, using any of the Media CDN’s APIs (via gcloud, Cloud Console, Terraform etc.,), as those requests would have been timed out. The data plane serving user HTTP requests were unaffected.
10 Jul 2023 11:38 PDT

The issue with Media CDN has been resolved for all affected users as of Monday, 2023-07-10 11:37 US/Pacific.

We thank you for your patience while we worked on resolving the issue.
10 Jul 2023 11:17 PDT

Summary: Media CDN is experiencing issues with configuration changes

Description: Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide more information by Monday, 2023-07-10 11:50 US/Pacific.

Diagnosis: None at this time.

Workaround: None at this time.