Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google BigQuery

Google BigQuery autoscaling may not succeed in EU multiregion

Incident began at 2023-11-22 01:34 and ended at 2023-11-22 03:28 (all times are US/Pacific).

Previously affected location(s)

Multi-region: eu

Date Time Description
22 Nov 2023 16:10 PST

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support

(All Times US/Pacific)

Incident Start: 22 November 2023 01:34

Incident End: 22 November 2023 03:28

Duration: 1 hour, 54 minutes

Affected Services and Features:

Google BigQuery - Workload Management

Regions/Zones: multi-regions: eu

Description:

A limited number of Google BigQuery users experienced issues with slot autoscaling for a duration of 1 hour, 54 minutes.

BigQuery’s capacity management system is responsible for evaluating slot availability and redistributing capacity if availability is low in any of the clusters in a given region. From preliminary analysis, the root cause of the issue is an error in BigQuery’s capacity management system that prevented it from taking necessary actions to redistribute capacity among clusters within the multi-region eu.

The issue was mitigated by adding more resources to the clusters in the multi-region eu and by fixing the error in BigQuery’s Capacity management so that the redistribution works.

Customer Impact:

  • Impacted customers of Google BigQuery in multi-regions:eu were unable to fully autoscale to their configured limit.
22 Nov 2023 03:31 PST

The issue with Google BigQuery has been resolved for all affected users as of Wednesday, 2023-11-22 03:30 US/Pacific.

We thank you for your patience while we worked on resolving the issue.
22 Nov 2023 02:31 PST

Summary: Google BigQuery autoscaling may not succeed in EU multiregion

Description: Mitigation work is currently underway by our engineering team.

The mitigation is expected to complete by Wednesday, 2023-11-22 04:00 US/Pacific.

We will provide more information by Wednesday, 2023-11-22 04:00 US/Pacific.

Diagnosis: Reservations are not able to be created, or increased by autoscaling.

Workaround: Scaling may succeed as the issue is intermittent, attempt retry.
22 Nov 2023 02:25 PST

Summary: Google BigQuery autoscaling may not succeed in EU multiregion

Description: We are experiencing an intermittent issue with Google BigQuery.

Our engineering team continues to investigate the issue.

We will provide an update by Wednesday, 2023-11-22 03:00 US/Pacific with current details.

Diagnosis: Reservations are not able to be created, or increased by autoscaling.

Workaround: Scaling may succeed as the issue is intermittent, attempt retry.
22 Nov 2023 02:19 PST

Summary: We've received a report of an issue with Google BigQuery.

Description: We are investigating a potential issue with Google BigQuery.

We will provide more information by Wednesday, 2023-11-22 02:50 US/Pacific.

Diagnosis: None at this time.

Workaround: None at this time.