Service Health
-
-
-
-
Incident affecting Cloud Memorystore, Memorystore for Redis
Google engineers are investigating a global issue with Cloud Memorystore.
Incident began at 2022-12-20 01:42 and ended at 2022-12-20 11:15 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)
| Date | Time | Description | |
|---|---|---|---|
| | 20 Dec 2022 | 16:02 PST | Mini Incident ReportWe apologize for the inconvenience this service disruption may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support . (All Times US/Pacific) Incident Start: 15 Dec 2022 18:30 Incident End: 20 Dec 2022 09:54 Duration: 4 days, 15 hours, 24 minutes Affected Services and Features: Cloud Memory Store: GUI Instance Provisioning Regions/Zones: Global Description: Cloud Memory Store users experienced sporadic levels of inability to create new instances from 15 Dec 2022 at 18:30 PT until 19 Dec 2022 16:00, when the failure rate reached 100%. The root cause for this issue was an errant configuration rollout. Customer Impact:
|
| | 20 Dec 2022 | 11:15 PST | The issue with Cloud Memorystore has been resolved for all affected users as of Tuesday, 2022-12-20 11:14 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| | 20 Dec 2022 | 09:22 PST | Summary: Google engineers are investigating a global issue with Cloud Memorystore. Description: Mitigation work is currently underway by our engineering team. The mitigation is expected to complete by Tuesday, 2022-12-20 11:30 US/Pacific. We will provide more information by Tuesday, 2022-12-20 11:30 US/Pacific. Diagnosis:Customers are unable to provision a new instance using Google Cloud Console, the region field will not populate. Workaround: Customer can use gcloud redis instance create command to provision an instance and the gcloud redis regions list. eg gcloud --project=<project_name> redis instances create <instance_name> --size=1 --tier=<basic/standard> --region= |
| | 20 Dec 2022 | 07:41 PST | Summary: Google engineers are investigating a global issue with Cloud Memorystore. Description: Mitigation work is currently underway by our engineering team. The mitigation is expected to complete by Tuesday, 2022-12-20 08:45 US/Pacific. We will provide more information by Tuesday, 2022-12-20 09:30 US/Pacific. Diagnosis: Customers are unable to provision a new instance using Google Cloud Console, the region field will not populate. Workaround: Customer can use gcloud redis instance create command to provision an instance and the gcloud redis regions list. eg gcloud --project=<project_name> redis instances create <instance_name> --size=1 --tier=<basic/standard> --region= |
| | 20 Dec 2022 | 03:29 PST | Summary: Google engineers are investigating a global issue with Cloud Memorystore. Description: Mitigation work is currently underway by our engineering team. The mitigation is expected to complete by Tuesday, 2022-12-20 08:45 US/Pacific. We will provide more information by Tuesday, 2022-12-20 09:30 US/Pacific. Diagnosis:Customers are unable to provision a new instance using Google Cloud Console, the region field will not populate. Workaround: Customer can use gcloud redis instance create command to provision an instance and the gcloud redis regions list. |
| | 20 Dec 2022 | 03:28 PST | Summary: Google engineers are investigating a global issue with Cloud Memorystore. Description: Mitigation work is currently underway by our engineering team. The mitigation is expected to complete by Tuesday, 2022-12-20 04:45 US/Pacific. We will provide more information by Tuesday, 2022-12-20 09:00 US/Pacific. Diagnosis:Customers are unable to provision a new instance using Google Cloud Console, the region field will not populate. Workaround: Customer can use gcloud redis instance create command to provision an instance and the gcloud redis regions list. |
| | 20 Dec 2022 | 02:52 PST | Summary: Google engineers are investigating a global issue with Cloud Memorystore. Description: We are experiencing an issue with Cloud Memorystore beginning at Tuesday, 2022-12-20 00:00 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2022-12-20 04:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis:Customers are unable to provision a new instance using Google Cloud Console, the region field will not populate. Workaround: Customer can use gcloud redis instance create command to provision an instance and the gcloud redis regions list. |
| | 20 Dec 2022 | 02:36 PST | Summary: Google engineers are investigating a global issue with Cloud Memorystore. Description: We are experiencing an issue with Cloud Memorystore beginning at Tuesday, 2022-12-20 00:00 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2022-12-20 04:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis:Customers are unable to provision a new instance using Google Cloud Console, the region field will not populate. Workaround: Customer can use gcloud redis instance create command to provision an instance and the gcloud redis regions list. |
| | 20 Dec 2022 | 01:55 PST | Summary: Google engineers are investigating a global issue with Cloud Memorystore. Description: We are experiencing an issue with Cloud Memorystore beginning at Tuesday, 2022-12-20 00:00 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2022-12-20 03:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers are unable to provision a new instance using Google Cloud Console, the region field will not populate. Workaround: None at this time. |
| | 20 Dec 2022 | 01:54 PST | Summary: Google engineers are investigating a global issue with Cloud Memorystore. Description: We are experiencing an issue with Cloud Memorystore beginning at Tuesday, 2022-12-20 00:00 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2022-12-20 02:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers are unable to provision a new instance using Google Cloud Console, the region field will not populate. Workaround: None at this time. |
- All times are US/Pacific