Service Health
-
-
-
-
Incident affecting Google App Engine
Global: Google App Engine Deployment Failures
Incident began at 2023-03-16 16:21 and ended at 2023-03-20 09:37 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Warsaw (europe-central2)Belgium (europe-west1)London (europe-west2)Frankfurt (europe-west3)Zurich (europe-west6)Montréal (northamerica-northeast1)São Paulo (southamerica-east1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)
| Date | Time | Description | |
|---|---|---|---|
| | 20 Mar 2023 | 09:37 PDT | The issue with Google App Engine has been resolved for all affected users as of Monday, 2023-03-20 09:20 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| | 19 Mar 2023 | 19:36 PDT | Summary: Global: Google App Engine Deployment Failures Description: The fix rollout has completed and our engineering team is currently monitoring the customer impact. We will provide more information by Monday, 2023-03-20 10:00 US/Pacific. Diagnosis: Some customers attempting to deploy apps on GAE will experience intermittent build errors: 'INTERNAL'. Workaround: Customers can unblock themselves by disabling the build cache when deploying the GAE: gcloud app deploy --no-cache. |
| | 19 Mar 2023 | 14:40 PDT | Summary: Global: Google App Engine Deployment Failures Description: The fix rollout has completed and our engineering team is currently monitoring the customer impact. We will provide more information by Sunday, 2023-03-19 20:00 US/Pacific. Diagnosis: Some customers attempting to deploy apps on GAE will experience intermittent build errors: 'INTERNAL'. Workaround: Customers can unblock themselves by disabling the build cache when deploying the GAE: gcloud app deploy --no-cache. |
| | 18 Mar 2023 | 21:03 PDT | Summary: Global: Google App Engine Deployment Failures Description: Mitigation work is currently underway by our engineering team. The mitigation is expected to complete by Monday, 2023-03-20 17:00 US/Pacific. We will provide more information by Sunday, 2023-03-19 17:00 US/Pacific. Diagnosis: Some customers attempting to deploy apps on GAE will experience intermittent build errors: 'INTERNAL'. Workaround: Customers can unblock themselves by disabling the build cache when deploying the GAE: gcloud app deploy --no-cache. |
| | 16 Mar 2023 | 21:43 PDT | Summary: Global: Google App Engine Deployment Failures Description: Mitigation work is still underway by our engineering team. Current data indicates that approximately 1% of users are affected globally by this issue. We will provide more information by Saturday, 2023-03-18 23:00 US/Pacific. Diagnosis: Some customers attempting to deploy apps on GAE will experience intermittent build errors: 'INTERNAL'. Workaround: Customers can unblock themselves by disabling the build cache when deploying the GAE: gcloud app deploy --no-cache. |
| | 16 Mar 2023 | 18:07 PDT | Summary: Global: Google App Engine Deployment Failures Description: We are experiencing an issue with Google App Engine. Our engineering team continues to investigate the issue and are working on a fix. We will provide an update by Thursday, 2023-03-16 23:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Some customers attempting to deploy apps on GAE will experience intermittent build errors: 'INTERNAL'. Workaround: Customers can unblock themselves by disabling the build cache when deploying the GAE: gcloud app deploy --no-cache. |
| | 16 Mar 2023 | 17:33 PDT | Summary: Global: Google App Engine Deployment Failures Description: We are experiencing an issue with Google App Engine. Our engineering team continues to investigate the issue and are working on a fix. We will provide an update by Thursday, 2023-03-16 18:10 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Some customers attempting to deploy apps on GAE will experience intermittent build errors: 'INTERNAL'. Workaround: Customers can unblock themselves by disabling the build cache when deploying the GAE: gcloud app deploy --no-cache. |
| | 16 Mar 2023 | 17:09 PDT | Summary: Global: Google App Engine Deployment Failures Description: We are experiencing an issue with Google App Engine. Our engineering team continues to investigate the issue and identify root cause. We will provide an update by Thursday, 2023-03-16 17:40 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Some customers attempting to deploy apps on GAE will experience intermittent build errors: 'INTERNAL'. Workaround: Customers can unblock themselves by disabling the build cache when deploying the GAE: gcloud app deploy --no-cache. |
| | 16 Mar 2023 | 16:41 PDT | Summary: Global: Google App Engine Deployment Failures Description: We are experiencing an issue with Google App Engine. Our engineering team continues to investigate the issue. We will provide an update by Thursday, 2023-03-16 17:10 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Some customers attempting to deploy apps on GAE will experience intermittent build errors: 'INTERNAL'. Workaround: Customers can unblock themselves by disabling the build cache when deploying the GAE: gcloud app deploy --no-cache. |
- All times are US/Pacific