Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google Cloud Dataflow

We are investigating an issue with Cloud Dataflow.

Incident began at 2020-02-22 13:25 and ended at 2020-02-22 17:25 (all times are US/Pacific).

Date Time Description
22 Feb 2020 17:25 PST

The issue with Cloud Dataflow has been resolved for all affected users as of Saturday, 2020-02-22 17:24 US/Pacific. If you have a job in an unhealthy state, either failed or queued for more than 6 hours, please restart it so that it is executed correctly, or contact Support for more information.

We thank you for your patience while we've worked on resolving the issue.

22 Feb 2020 16:31 PST

Description: We are investigating an issue with Cloud Dataflow. Jobs using Dataflow Shuffle may fail or (when using Flexible Resource Scheduling) be queued indefinitely. Mitigation work is still underway by our engineering team. At this time we don't have an ETA for a full recovery yet.

We will provide more information by Saturday, 2020-02-22 17:30 US/Pacific at the latest.

Workaround: Jobs that fail to run should be re-tried by canceling any pipelines affected by the incident and re-running them.

22 Feb 2020 15:31 PST

Description: We are investigating an issue with Cloud Dataflow. Jobs using Dataflow Shuffle may fail or (when using Flexible Resource Scheduling) be queued indefinitely. Mitigation work is still underway by our engineering team.

We will provide more information by Saturday, 2020-02-22 16:30 US/Pacific at the latest.

Workaround: Jobs that fail to run should be re-tried by canceling any pipelines affected by the incident and re-running them.

22 Feb 2020 14:31 PST

Description: We are investigating an issue with Cloud Dataflow. Jobs using Dataflow Shuffle may fail or (when using Flexible Resource Scheduling) be queued indefinitely. Mitigation work is still underway by our engineering team.

We will provide more information by Saturday, 2020-02-22 15:30 US/Pacific at the latest.

Workaround: Jobs that fail to run should be re-tried by canceling any pipelines affected by the incident and re-running them.

22 Feb 2020 14:09 PST

Description: We are investigating an issue with Cloud Dataflow. Jobs using Dataflow Shuffle may fail or (when using Flexible Resource Scheduling) be queued indefinitely. Mitigation work is currently underway by our engineering team.

We will provide more information by Saturday, 2020-02-22 14:30 US/Pacific.

Workaround: Jobs that fail to run should be re-tried by canceling any pipelines affected by the incident and re-running them.