Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Cloud Workstations

Cloud Workstations service issues for us-central1 and us-west1regions.

Incident began at 2024-03-26 12:50 and ended at 2024-03-26 17:30 (all times are US/Pacific).

Previously affected location(s)

Iowa (us-central1)Oregon (us-west1)

Date Time Description
27 Mar 2024 11:16 PDT

Mini Incident Report

We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below.

Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support or to Google Workspace Support using the help article https://support.google.com/a/answer/1047213.

(All Times US/Pacific)

Incident Start: 26 March 2024 12:50

Incident End: 26 March, 2024 17:30

Duration: 4 hours, 40 minutes

Affected Services and Features:

Cloud Workstations

Regions/Zones:

us-west1, us-central1

Description:

Google Cloud Workstations in us-west1 and us-central1 experienced 500 internal errors and slow load time in the Cloud Console for a duration of 4 hours 40 minutes. Our preliminary analysis shows the root cause of the issue being a transient overload of our API servers.

The traffic overload was due to a configuration change which was quickly identified and rolled back.

Google engineers mitigated the issue by throttling traffic as required to normalize resource utilization and serve all requests.

Customer Impact:

  • Impacted customers would have observed 500 internal errors.
  • Experienced slow load times in the Cloud Console.
26 Mar 2024 17:35 PDT

The issue with Cloud Workstations has been resolved for all affected users as of Tuesday, 2024-03-26 17:20 US/Pacific.

We thank you for your patience while we worked on resolving the issue.

26 Mar 2024 17:10 PDT

Summary: Cloud Workstations service issues for us-central1 and us-west1regions.

Description: Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide more information by Tuesday, 2024-03-26 18:15 US/Pacific.

Diagnosis: Impacted customers may receive errors or experience slow load times viewing workstations in the cloud console.

Workaround: Customers may reload the page in pantheon.

26 Mar 2024 16:14 PDT

Summary: Cloud Workstations service issues for us-central1 and us-west1 regions.

Description: We are experiencing an issue with Cloud Workstations.

Our engineering team continues to investigate the issue.

We will provide an update by Tuesday, 2024-03-26 17:15 US/Pacific with current details.

We apologize to all who are affected by the disruption.

Diagnosis: Impacted customers may receive 500 internal error while trying to access Cloud Workstation.

Workaround: None at this time.