Console

Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google Compute Engine

Global: High Memory Issues on GCE Windows VMs using Google Cloud Ops Agent >= 2.27.0

Incident began at 2023-04-11 15:28 and ended at 2023-04-13 19:20 (all times are US/Pacific).

Previously affected location(s)

Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)Turin (europe-west12)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Tel Aviv (me-west1)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)

Date Time Description
13 Apr 2023 19:20 PDT

The issue with Google Cloud Ops Agent has been resolved for all affected users as of Thursday, 2023-04-13 19:05 US/Pacific.

Affected customers should upgrade to the latest Google Cloud Ops Agent release 2.30.0 which includes the fix for this issue. Instructions are available: https://cloud.google.com/monitoring/agent/ops-agent/installation#upgrade

We thank you for your patience while we worked on resolving the issue.
12 Apr 2023 15:04 PDT

Summary: Global: High Memory Issues on GCE Windows VMs using Google Cloud Ops Agent >= 2.27.0

Description: Mitigation work is currently underway by our engineering team and they are currently validating the fix.

We will provide more information by Friday, 2023-04-14 17:00 US/Pacific..

Diagnosis: Customers impacted by this issue may observe high memory usage with GCE Windows VMs using Google Cloud Ops Agent versions >= 2.27.0.

Workaround: Affected customers should downgrade to version 2.26.0. Instructions are available: https://cloud.google.com/stackdriver/docs/solutions/agents/ops-agent/troubleshoot-run-ingest#high_memory_usage_on_windows_vms_versions_2270_and_newer
11 Apr 2023 15:28 PDT

Summary: Global: High Memory Issues on GCE Windows VMs using Google Cloud Ops Agent >= 2.27.0

Description: We are experiencing an issue with Google Compute Engine Windows VMs using Google Cloud Ops Agent beginning on Thursday, 2023-02-23 14:14 US/Pacific.

Our engineering team is working on a fix and verifying it addresses the issue.

We will provide an update by Friday, 2023-04-14 17:00 US/Pacific with current details.

We apologize to all who are affected by the disruption.

Diagnosis: Customers impacted by this issue may observe high memory usage with GCE Windows VMs using Google Cloud Ops Agent versions >= 2.27.0.

Workaround: Affected customers should downgrade to version 2.26.0. Instructions are available: https://cloud.google.com/stackdriver/docs/solutions/agents/ops-agent/troubleshoot-run-ingest#high_memory_usage_on_windows_vms_versions_2270_and_newer