Service Health
Incident affecting Apigee, Google Compute Engine, Cloud Memorystore, Google Cloud Dataflow, Google Cloud Networking, Google Cloud Composer, Google Cloud SQL, Cloud Load Balancing, Cloud Filestore, Google App Engine, AlloyDB for PostgreSQL, Virtual Private Cloud (VPC), Memorystore for Memcached, Memorystore for Redis
Multiple Google Cloud Platform services impacted globally with operational latency
Incident began at 2023-06-12 17:15 and ended at 2023-06-12 21:48 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)Turin (europe-west12)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Doha (me-central1)Tel Aviv (me-west1)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)
Date | Time | Description | |
---|---|---|---|
| 12 Jun 2023 | 22:44 PDT | The issue with Apigee, Cloud Filestore, Cloud Load Balancing, Cloud Memorystore, Google App Engine, Google Cloud Composer, Google Cloud Dataflow, Google Cloud Networking, Google Cloud SQL, Google Compute Engine, Google Kubernetes Engine, Virtual Private Cloud and AlloyDB for PostgreSQL has been resolved for all affected users as of Monday, 2023-06-12 21:48 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| 12 Jun 2023 | 22:07 PDT | Summary: Multiple Google Cloud Platform services impacted globally with operational latency Description: Mitigation work is still underway by our engineering team. We will provide more information by Monday, 2023-06-12 22:45 US/Pacific. Diagnosis: Users may observe failures or delayed operations for affected GCP services. Google Compute Engine Impact/Diagnosis: Impacted users may experience elevated latency for API calls to global, regional and zonal resources. Cloud Memorystore Impact/Diagnosis: Users may not be able to create new Redis instances, and likely not be able to delete instances. Google Cloud Composer Impact/Diagnosis: Users may observe failures while running create operations using Cloud Composer. Google Cloud Dataflow Impact/Diagnosis: Impacted customers may see increased latency during WorkerPool start up and for Dataflow jobs. Google Cloud App Engine Impact/Diagnosis: Flex deployments are failing or timing out Cloud Filestore Impact/Diagnosis: Attempts to create, delete, or back up instances may fail. Google Cloud SQL Impact/Diagnosis: Instance creation, backup create/restore/delete operations are failing with error 503: "The service is currently unavailable." Apigee X Impact/Diagnosis: Attempts to create, delete, or back up instances may fail. Cloud Load Balancing Impacted customers may experience failures while performing create, delete, or edit operations on Layer 7 internal or external load balancers or their dependencies. Workaround: None at this time for all services except Google Cloud SQL where retrying the failed operation may help. |
| 12 Jun 2023 | 21:46 PDT | Summary: Multiple Google Cloud Platform services impacted globally with operational latency Description: We are experiencing an issue with Cloud Memorystore, Google Compute Engine, Google Cloud Composer, Google Cloud Networking, Cloud Filestore, Google App Engine, Apigee, Google Cloud SQL, Google Cloud Dataflow beginning at Monday, 2023-06-12 17:15 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Monday, 2023-06-12 22:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Users may observe failures or delayed operations for affected GCP services. Google Compute Engine Impact/Diagnosis: Impacted users may experience elevated latency for API calls to global, regional and zonal resources. Cloud Memorystore Impact/Diagnosis: Users may not be able to create new Redis instances, and likely not be able to delete instances. Google Cloud Composer Impact/Diagnosis: Users may observe failures while running create operations using Cloud Composer. Google Cloud Dataflow Impact/Diagnosis: Impacted customers may see increased latency during WorkerPool start up and for Dataflow jobs. Google Cloud App Engine Impact/Diagnosis: Flex deployments are failing or timing out Cloud Filestore Impact/Diagnosis: Attempts to create, delete, or back up instances may fail. Google Cloud SQL Impact/Diagnosis: Instance creation, backup create/restore/delete operations are failing with error 503: "The service is currently unavailable." Apigee X Impact/Diagnosis: Attempts to create, delete, or back up instances may fail. Workaround: None at this time. |
| 12 Jun 2023 | 21:23 PDT | Summary: Multiple Google Cloud Platform services impacted globally with operational latency Description: We are experiencing an issue with Cloud Memorystore, Google Compute Engine, Google Cloud Composer, Google Cloud Networking, Cloud Filestore, Google App Engine, Google Kubernetes Engine, Apigee, Google Cloud SQL, Google Cloud Dataflow beginning at Monday, 2023-06-12 17:15 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Monday, 2023-06-12 22:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Users may observe failures or delayed operations for affected GCP services. Workaround: None at this time. |
| 12 Jun 2023 | 20:48 PDT | Summary: Multiple Google Cloud Platform services impacted globally with operational latency Description: We are experiencing an issue with Cloud Memorystore, Google Compute Engine, Google Cloud Composer, Google Cloud Networking, Cloud Filestore, Google App Engine, Google Kubernetes Engine, Apigee, Google Cloud SQL, Google Cloud Dataflow beginning at Monday, 2023-06-12 17:15 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Monday, 2023-06-12 21:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Users may observe failures or delayed operations for affected GCP services. Workaround: None at this time. |
- All times are US/Pacific