Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google Cloud Dataflow

Cloud Dataflow: Some Streaming Appliance Jobs stalling due to deleted workers

Incident began at 2022-11-18 17:18 and ended at 2022-11-18 18:46 (all times are US/Pacific).

Previously affected location(s)

Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)

Date Time Description
18 Nov 2022 18:46 PST

The issue with Google Cloud Dataflow has been resolved for all affected projects as of Friday, 2022-11-18 18:33 US/Pacific.

Affected customers can now restart their jobs and they should complete successfully.

We thank you for your patience while we worked on resolving the issue.
18 Nov 2022 17:50 PST

Summary: Cloud Dataflow: Some Streaming Appliance Jobs stalling due to deleted workers

Description: Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide more information by Friday, 2022-11-18 20:00 US/Pacific.

Diagnosis: Customers may experience stalled Streaming Appliance jobs due to deleted workers.

Workaround: If possible - run jobs on Streaming Engine [https://cloud.google.com/dataflow/docs/guides/deploying-a-pipeline#streaming-engine] which is not affected by this issue
18 Nov 2022 17:18 PST

Summary: Cloud Dataflow: Jobs stalling due to deleted workers

Description: Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide more information by Friday, 2022-11-18 18:30 US/Pacific.

Diagnosis: Customers may experience stalled Dataflow jobs due to deleted workers.

Workaround: None at this time.