Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Cloud Firestore

Firestore databases in nam5 multi-region are unable to issue any streaming reads/writes

Incident began at 2022-11-09 06:23 and ended at 2022-11-09 07:11 (all times are US/Pacific).

Previously affected location(s)

Multi-region: nam5

Date Time Description
10 Nov 2022 14:08 PST

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support or to Google Workspace Support using help article https://support.google.com/a/answer/1047213.

(All Times US/Pacific)

Incident Start: 09 November 2022 06:23

Incident End: 09 November 2022 07:11

Duration: 48 minutes

Affected Services and Features:

Cloud Firestore

Regions/Zones: Multi-region: nam5

Description:

Cloud Firestore in nam5 were under-provisioned during the peak daily load for a period of 48 minutes. From preliminary analysis, the root cause of the issue is due to a bad configuration push, which left nam5 regions at reduced serving capacity and affected performance during peak load. Since the change was applied during nonpeak hours, the impact was not immediately observed.

Customer Impact:

Customers using Firestore databases in the nam5 regions observed severe degradation in streaming read
9 Nov 2022 07:40 PST

The issue with Cloud Firestore has been resolved for all affected users as of Wednesday, 2022-11-09 07:15 US/Pacific.

We thank you for your patience while we worked on resolving the issue.
9 Nov 2022 07:25 PST

Summary: Firestore databases in nam5 multi-region are unable to issue any streaming reads/writes

Description: We believe the issue with Cloud Firestore is now resolved. We will continue to monitor services for now.

We will provide an update by Wednesday, 2022-11-09 08:30 US/Pacific with current details.

Diagnosis: Firestore databases in nam5 multi-region were unable to issue any streaming reads/writes.

Workaround: None at this time.
9 Nov 2022 07:11 PST

Summary: Firestore databases in nam5 multi-region are unable to issue any streaming reads/writes

Description: We are experiencing an issue with Cloud Firestore beginning at Wednesday, 2022-11-09 06:23 US/Pacific.

Our engineering team continues to investigate the issue.

We will provide an update by Wednesday, 2022-11-09 08:20 US/Pacific with current details.

We apologize to all who are affected by the disruption.

Diagnosis: Firestore databases in nam5 multi-region are unable to issue any streaming reads/writes.

Workaround: None at this time.