Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google App Engine

App Engine Flexible Create Update and Delete endpoints failing

Incident began at 2022-12-01 12:20 and ended at 2022-12-01 13:36 (all times are US/Pacific).

Date Time Description
1 Dec 2022 16:55 PST

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support

(All Times US/Pacific)

Incident Start: 01 December 2022 12:20

Incident End: 01 December 2022 13:36

Duration: 1 hour, 16 minutes

Affected Services and Features:

Google App Engine Flexible

Regions/Zones: Global

Description:

Google App Engine (GAE) Flexible deployments experienced elevated latency and error rates globally for a duration of 1 hour 16 minutes. From preliminary analysis, the root cause of the issue is due to 100% DEADLINE_EXCEEDED errors from a dependency service. Google engineering is continuing to investigate the matter, and we will update the final root cause analysis in the Mini Incident Report.

Customer Impact:

  • Affected customers were unable to create, update and delete endpoints and received deadline exceeded errors.
  • Up to ~80% of GAE Flexible projects may have experienced issues with create, update, delete operations.

1 Dec 2022 13:41 PST

The issue with Google App Engine has been resolved for all affected projects as of Thursday, 2022-12-01 13:36 US/Pacific.

Affected customers can now retry operations that were previously failing.

We thank you for your patience while we worked on resolving the issue.

1 Dec 2022 13:20 PST

Summary: App Engine Flexible Control Plane Create Update and Delete endpoints are failing

Description: We've received a report of an issue with Google App Engine as of Thursday, 2022-12-01 13:00 US/Pacific. We will provide more information by Thursday, 2022-12-01 14:00 US/Pacific.

Location: Global

Diagnosis: Affected customers are unable to create, update and delete endpoints and will receive deadline exceeded errors.

Workaround: None at this time.