Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google Cloud SQL

Customers are unable to create read replica with private IP for Cloud SQL

Incident began at 2023-05-07 12:47 and ended at 2023-05-07 17:06 (all times are US/Pacific).

Previously affected location(s)

Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)Turin (europe-west12)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Doha (me-central1)Tel Aviv (me-west1)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)

Date Time Description
8 May 2023 23:17 PDT

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support.

(All Times US/Pacific)

Incident Start: 7 May, 2023 12:47

Incident End: 7 May, 2023 17:06

Duration: 4 hours, 19 minutes

Affected Services and Features:

Cloud SQL

Regions/Zones: Global

Description:

Cloud SQL customers experienced “Invalid Request” errors when attempting to create read replicas for a duration of 4 hours, 19 minutes. From preliminary analysis, the root cause of the issue was a recent change where the Cloud Console UI stopped sending private IP information to the Cloud SQL Admin API for creating read replica requests.

Customer Impact:

Customers would have experienced the error “Invalid request: At least one of Public or Private IP connectivity must be enabled” when attempting to create a Cloud SQL read replica in Cloud Console.

Additional details:

Google engineers mitigated the issue on 7 May 2023 at 17:06 US/Pacific by rolling back the recent change made to the Cloud Console UI.
7 May 2023 17:19 PDT

The issue with Google Cloud SQL has been resolved for all affected users as of Sunday, 2023-05-07 17:19 US/Pacific.

We thank you for your patience while we worked on resolving the issue.
7 May 2023 16:18 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 18:30 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances.

Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Workaround: Users are being instructed to : Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround.
7 May 2023 16:14 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances.

Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Workaround: Users are being instructed to : Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround.
7 May 2023 16:10 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details.

Users are being instructed to : Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create

Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances.

Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity m

Workaround: Customers provided directions above to explicitly specify the VPC network
7 May 2023 16:00 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances.

Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Users can follow these steps as a workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create

Workaround: Customers provided directions above to explicitly specify the VPC network
7 May 2023 15:55 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances.

Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround. Example: gcloud sql instances create

7 May 2023 15:54 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances.

Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround.

Example: gcloud sql instances create

7 May 2023 15:48 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances.

Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround.

Example: gcloud sql instances create

7 May 2023 15:08 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 16:30 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replicas with only private IP for Cloud SQL instances. Replica creation without public IP configured in UI will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Replica creation without public IP using gcloud command as below will alsoresult in the same error. gcloud sql instances create

Workaround: Users can use gcloud command and explicitly specify the VPC network with --network flag, as a workaround.

Example: gcloud sql instances create

7 May 2023 14:21 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 15:00 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replica with only private IP. Replica creation without public IP configured in UI or gcloud command will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Workaround: None at this time
7 May 2023 13:43 PDT

Summary: Customers are unable to create read replica with private IP for Cloud SQL

Description: We are experiencing an issue with Google Cloud SQL.

Our engineering team continues to investigate the issue.

We will provide an update by Sunday, 2023-05-07 14:30 US/Pacific with current details.

Diagnosis: Customers are unable to create new read replica with only private IP. Replica creation without public IP configured in UI or gcloud command will result in the following error: “Invalid request: At least one of Public IP or Private IP connectivity must be enabled”

Workaround: None at this time