Service Health
Incident affecting Google Cloud SQL
Global: Cloud SQL MySQL 8.0.33 is experiencing some issues with create and upgrade workflow.
Incident began at 2023-05-23 09:04 and ended at 2023-05-30 00:08 (all times are US/Pacific).
Date | Time | Description | |
---|---|---|---|
| 30 May 2023 | 00:08 PDT | The issue with Google Cloud SQL MySQL 8.0.33 has been resolved for all affected users as of Monday, 2023-05-29 18:21 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| 23 May 2023 | 17:45 PDT | Summary: Global: Cloud SQL MySQL 8.0.33 is experiencing some issues with create and upgrade workflow. Description: Creating a MySQL 8.0.33 instance may fail in most regions. Existing MySQL 8.0.33 instances will continue to work. Mitigation work is currently underway by our engineering team. The mitigation is expected to be completed by Wednesday, 2023-05-31 17:00 US/Pacific. We will provide more information by Wednesday, 2023-05-31 17:00 US/Pacific. Diagnosis: When the UI is used to create/upgrade an instance to MySQL 8.0.33, the operation will fail with an error message “An unknown error occurred”. When the create/upgrade is done from the CLI, it will fail with an error message “(gcloud.sql.instances.patch) [INTERNAL]”. There will be no impact or downtime to the database operation if the upgrade is not successful. Workaround: There is no workaround for creation failures. If the upgrade to MySQL 8.0.33 fails, customers can upgrade to MySQL minor version MySQL 8.0.26, and then perform another upgrade from MySQL 8.0.26 to MySQL 8.0.33. You can check if an instance can be upgraded to 8.0.33 by checking the DATABASE_VERSION using gcloud as below. This shows the SqlDatabaseVersion string (https://cloud.google.com/sql/docs/mysql/admin-api/rest/v1beta4/SqlDatabaseVersion). If the string includes a minor version, for example MYSQL_8_0_26, then the instance is not impacted and can be successfully upgraded to 8.0.33. If it does not include the minor version, for example MYSQL_5_7 or MYSQL_8_0, then the instance is impacted and the upgrade will fail. gcloud --project= |
| 23 May 2023 | 17:07 PDT | Summary: Global: CloudSQL MySQL 8.0.33 is experiencing some issues with create and upgrade workflow. Description: Our engineering team continues to work on a mitigation plan. We will provide more information by Tuesday, 2023-05-23 18:00 US/Pacific. Diagnosis: Customers are unable to create or perform upgrades to MySQL 8.0.33 and may experience an internal CloudSQL error. If an upgrade failure occurs, it will not incur downtime or impact to the instance. Workaround: None at this time. |
| 23 May 2023 | 13:25 PDT | Summary: Global: CloudSQL MySQL 8.0.33 is experiencing some issues with create and upgrade workflow. Description: Our engineering team continues to work on a mitigation plan. We will provide more information by Tuesday, 2023-05-23 17:00 US/Pacific. Diagnosis: Customers are unable to create or perform upgrades to MySQL 8.0.33 and may experience an internal CloudSQL error. If an upgrade failure occurs, it will not incur downtime or impact to the instance. Workaround: None at this time. |
- All times are US/Pacific