Service Health
Incident affecting Google Cloud SQL
Some multiple-table DMLs intermittently are not working on MySQL versions 8.0.30+ with query insights enabled.
Incident began at 2023-11-27 05:01 and ended at 2023-11-29 13:56 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)Berlin (europe-west10)Turin (europe-west12)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Doha (me-central1)Dammam (me-central2)Tel Aviv (me-west1)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)
Date | Time | Description | |
---|---|---|---|
| 29 Nov 2023 | 13:56 PST | The issue with Google Cloud SQL has been resolved for all affected users as of Wednesday, 2023-11-29 13:55 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| 28 Nov 2023 | 09:46 PST | Summary: Some multiple-table DMLs intermittently are not working on MySQL versions 8.0.30+ with query insights enabled. Description: Our engineers and support teams continue to work on the mitigation identified. We understand that this issue has impacted your ability to access and use our services, we deeply appreciate your patience and cooperation while we work towards resolving the issue in hand. At the current rate of progress, we expect to complete the mitigation work by Wednesday, 2023-11-29 14:00 US/Pacific. We will provide more information by Wednesday, 2023-11-29 14:00 US/Pacific. We sincerely apologize for any inconvenience and troubles being caused at this time. Diagnosis: Some multiple-table DMLs intermittently don't work on Cloud SQL MySQL versions 8.0.30+ with query insights enabled. A multiple-table DML is a DML affecting more than one table, for example “UPDATE tableA join tableB ON Workaround: Customers using multiple-table DMLs and having query insights enabled, can disable query plans i.e. set the query_plans_per_minute to 0 by following the steps described below: https://cloud.google.com/sql/docs/mysql/using-query-insights#gcloud If tags are enabled, then insights-config-record-application-tags also need to be disabled. |
| 27 Nov 2023 | 09:35 PST | Summary: Some multiple-table DMLs intermittently don't work on MySQL versions 8.0.30+ with query insights enabled. Description: Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Tuesday, 2023-11-28 10:00 US/Pacific. Diagnosis: Some multiple-table DMLs intermittently don't work on Cloud SQL MySQL versions 8.0.30+ with query insights enabled. A multiple-table DML is a DML affecting more than one table, for example “UPDATE tableA join tableB ON Workaround: Customers using multiple-table DMLs and having query insights enabled, can disable query plans i.e. set the query_plans_per_minute to 0 by following the steps described below: https://cloud.google.com/sql/docs/mysql/using-query-insights#gcloud If tags are enabled, then insights-config-record-application-tags also need to be disabled. |
| 27 Nov 2023 | 08:47 PST | Summary: Some multiple-table DMLs intermittently don't work on MySQL versions 8.0.30+ with query insights enabled. Description: We are investigating a potential issue with Google Cloud SQL. We will provide more information by Monday, 2023-11-27 10:00 US/Pacific. Diagnosis: Some multiple-table DMLs intermittently don't work on Cloud SQL MySQL versions 8.0.30+ with query insights enabled. A multiple-table DML is a DML affecting more than one table, for example “UPDATE tableA join tableB ON Workaround: Customers using multiple-table DMLs and having query insights enabled, can disable query plans i.e. set the query_plans_per_minute to 0 by following the steps described below: https://cloud.google.com/sql/docs/mysql/using-query-insights#gcloud If tags are enabled, then insights-config-record-application-tags also need to be disabled. |
| 27 Nov 2023 | 06:51 PST | Summary: Some multiple-table DMLs intermittently don't work on MySQL versions 8.0.30+ with query insights enabled. Description: We are investigating a potential issue with Google Cloud SQL. We will provide more information by Monday, 2023-11-27 09:00 US/Pacific. Diagnosis: Some multiple-table DMLs intermittently don't work on Cloud SQL MySQL versions 8.0.30+ with query insights enabled. A multiple-table DML is a DML affecting more than one table, for example “UPDATE tableA join tableB ON Workaround: Customers using multiple-table DMLs and having query insights enabled, can disable query plans i.e. set the query_plans_per_minute to 0 by following the steps described below: https://cloud.google.com/sql/docs/mysql/using-query-insights#gcloud If tags are enabled, then insights-config-record-application-tags also need to be disabled. |
| 27 Nov 2023 | 05:54 PST | Summary: Some multiple-table DMLs intermittently don't work on MySQL versions 8.0.30+ with query insights enabled. Description: We are investigating a potential issue with Google Cloud SQL. We will provide more information by Monday, 2023-11-27 07:00 US/Pacific. Diagnosis: Some multiple-table DMLs intermittently don't work on Cloud SQL MySQL versions 8.0.30+ with query insights enabled. A multiple-table DML is a DML affecting more than one table, for example “UPDATE tableA join tableB ON Workaround: Customers using multiple-table DMLs and having query insights enabled, can disable query plans i.e. set the query_plans_per_minute to 0 by following the steps described below: https://cloud.google.com/sql/docs/mysql/using-query-insights#gcloud If tags are enabled, then insights-config-record-application-tags also need to be disabled. |
- All times are US/Pacific