Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Cloud Logging, Google BigQuery, Operations

Issue with BigQuery Streaming API and Cloud Logging in US Multiregion

Incident began at 2024-06-10 18:07 and ended at 2024-06-10 20:09 (all times are US/Pacific).

Previously affected location(s)

Multi-region: us

Date Time Description
11 Jun 2024 09:11 PDT

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support .

(All Times US/Pacific)

Incident Start: 10 June 2024 16:45

Incident End: 10 June 2024 20:00

Duration: 3 hours and 15 minutes

Affected Services and Features:

Google BigQuery and Google Cloud Logging

Regions/Zones: Multi-regions: US

Description:

BigQuery experienced elevated errors across multiple APIs in the US Multi-region due to the concurrent mitigation of simultaneous degradations, which impacted the BigQuery projects hosted in two degraded clusters. Google will complete a full IR in the following days that will provide a full root cause.

Customer Impact:

BigQuery: A subset of customers would have experienced HTTP 500 errors while executing calls to insertAll and storage write APIs in the US Multi-region. Additionally, some customers may have experienced system errors using the Jobs and Query API.

Cloud Logging: Cloud Logging customers using Log Analytics faced log ingestion delays up to 2 hours for their analytics buckets if they ingested logs via Cloud regions us-central1 or us-central2. Logs Explorer queries in the Google Cloud console were not impacted.
10 Jun 2024 20:09 PDT

The issue with Cloud Logging, Google BigQuery has been resolved for all affected users as of Monday, 2024-06-10 20:00 US/Pacific.

We will publish an analysis of this incident once we have completed our internal investigation.

We thank you for your patience while we worked on resolving the issue.
10 Jun 2024 19:06 PDT

Summary: Issue with BigQuery Streaming API and Cloud Logging in US Multiregion

Description: Google engineers are working on mitigating the problem and we are observing the error rate for the impacted APIs dropping. We are closely monitoring the progress of the problem mitigation.

We will provide more information by Monday, 2024-06-10 20:30 US/Pacific.

Diagnosis: Google BigQuery: Customers impacted by this issue may see 500 errors while executing BigQuery statements.

Cloud Logging: Ingestion delays to analytics buckets with local global. Logs Explorer queries are not affected.

Workaround: None at this time.
10 Jun 2024 18:36 PDT

Summary: Issue with BigQuery Streaming API and Cloud Logging

Description: We are experiencing an issue with Google BigQuery Streaming API, Cloud Logging beginning on Monday, 2024-06-10 16:46 US/Pacific.

Our engineering team continues to investigate the issue.

We will provide an update by Monday, 2024-06-10 18:59 US/Pacific with current details.

Diagnosis: Google BigQuery: Customers impacted by this issue may see 500 errors while executing BigQuery statements.

Cloud Logging: Ingestion delays to analytics buckets with local global. Logs Explorer queries are not affected.

Workaround: None at this time.