Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google BigQuery

BigQuery Jobs are experiencing latency regression

Incident began at 2023-11-20 00:00 and ended at 2023-11-20 03:12 (all times are US/Pacific).

Previously affected location(s)

Multi-region: us

Date Time Description
21 Nov 2023 10:00 PST

Mini Incident Report

We apologize for the inconvenience this service disruption may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support.

(All Times US/Pacific)

Incident Start: 20 November 2023 00:00

Incident End: 20 November 2023 03:12

Duration: 3 hours, 12 minutes

Affected Services and Features:

Google BigQuery

Regions/Zones: multi-region US

Description:

Google BigQuery experienced elevated latency degradation in the multi-region US for a duration of 3 hours, 12 minutes. From preliminary analysis, the root cause of the issue is due to a failure in an underlying storage layer dependency that controls metadata requests. The issue was mitigated by redirecting metadata request traffic to an alternate location.

Customer Impact:

Google BigQuery

  • Affected customers experienced elevated latency degradation in the multi-region US with query latency lasting up to a few minutes.
20 Nov 2023 03:27 PST

The issue with Google BigQuery has been resolved for all affected users as of Monday, 2023-11-20 03:15 US/Pacific.

We thank you for your patience while we worked on resolving the issue.
20 Nov 2023 03:01 PST

Summary: BigQuery Jobs are experiencing latency regression

Description: Mitigation work has been completed and currently we are monitoring the services to confirm if the issue was resolved.

We will provide more information by Monday, 2023-11-20 04:20 US/Pacific.

Diagnosis: The impacted customers may experience latency with BigQuery jobs.

Workaround: None at this time.
20 Nov 2023 02:24 PST

Summary: BigQuery Jobs are experiencing latency regression

Description: We are experiencing an issue with Google BigQuery.

The resolving teams are still investigating the issue.

We will provide an update by Monday, 2023-11-20 03:45 US/Pacific with current details.

Diagnosis: The impacted customers may experience latency with BigQuery jobs.

Workaround: None at this time.