Service Health
Incident affecting Cloud Filestore
Incorrect Enterprise/High Scale latency metrics in the Cloud Filestore
Incident began at 2022-12-21 18:29 and ended at 2022-12-29 04:27 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)
Date | Time | Description | |
---|---|---|---|
| 29 Dec 2022 | 04:27 PST | The issue with Cloud Filestore has been resolved for all affected projects as of Thursday, 2022-12-29 04:26 US/Pacific. If customers are still experiencing issues please raise a support case. We thank you for your patience while we worked on resolving the issue. |
| 22 Dec 2022 | 10:08 PST | Summary: Incorrect Enterprise/High Scale latency metrics in the Cloud Filestore Description: We are experiencing an issue with Cloud Filestore beginning at Wednesday, 2022-11-09 for new instances, and existing instances starting Thursday 2022-12-15. This issue will be corrected in the next software release in January. Customers can request fixes for specific instances prior to that by reaching out to Google support. We will provide an update by Thursday, 2022-12-29 10:30 US/Pacific with current details. Diagnosis: The enterprise and high scale Cloud Filestore instances are misreporting average read and write latency metrics. Workaround: While querying latency data, users need to 'multiply the value by 1000' to obtain the correct units. |
| 22 Dec 2022 | 07:16 PST | Summary: Incorrect Enterprise/High Scale latency metrics in the Cloud Filestore Description: We are experiencing an issue with Cloud Filestore beginning at Thursday, 2022-12-22 00:00 US/Pacific. Our engineering has identified a fix and are in the process of creating minimum disruption roll out plan. We will provide an update by Thursday, 2022-12-22 10:30 US/Pacific with current details. Diagnosis: The enterprise and high scale Cloud Filestore instances are misreporting average read and write latency metrics. Workaround: While querying latency data, users need to 'multiply the value by 1000' to obtain the correct units. |
| 21 Dec 2022 | 18:29 PST | Summary: Incorrect Enterprise/High Scale latency metrics in the Cloud Filestore Description: We are experiencing an issue with Cloud Filestore. Our engineering team continues to investigate the issue. We will provide an update by Thursday, 2022-12-22 08:00 US/Pacific with current details. Diagnosis: The enterprise and high scale Cloud Filestore instances are misreporting average read and write latency metrics. Workaround: While querying latency data, users need to 'multiply the value by 1000' to obtain the correct units. |
- All times are US/Pacific