Service Health
-
-
-
-
Incident affecting Google Compute Engine
Global: High Memory Issues on GCE Windows VMs using Google Cloud Ops Agent >= 2.27.0
Incident began at 2023-04-11 15:28 and ended at 2023-04-13 19:20 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)Turin (europe-west12)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Tel Aviv (me-west1)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)
| Date | Time | Description | |
|---|---|---|---|
| | 13 Apr 2023 | 19:20 PDT | The issue with Google Cloud Ops Agent has been resolved for all affected users as of Thursday, 2023-04-13 19:05 US/Pacific. Affected customers should upgrade to the latest Google Cloud Ops Agent release 2.30.0 which includes the fix for this issue. Instructions are available: https://cloud.google.com/monitoring/agent/ops-agent/installation#upgrade We thank you for your patience while we worked on resolving the issue. |
| | 12 Apr 2023 | 15:04 PDT | Summary: Global: High Memory Issues on GCE Windows VMs using Google Cloud Ops Agent >= 2.27.0 Description: Mitigation work is currently underway by our engineering team and they are currently validating the fix. We will provide more information by Friday, 2023-04-14 17:00 US/Pacific.. Diagnosis: Customers impacted by this issue may observe high memory usage with GCE Windows VMs using Google Cloud Ops Agent versions >= 2.27.0. Workaround: Affected customers should downgrade to version 2.26.0. Instructions are available: https://cloud.google.com/stackdriver/docs/solutions/agents/ops-agent/troubleshoot-run-ingest#high_memory_usage_on_windows_vms_versions_2270_and_newer |
| | 11 Apr 2023 | 15:28 PDT | Summary: Global: High Memory Issues on GCE Windows VMs using Google Cloud Ops Agent >= 2.27.0 Description: We are experiencing an issue with Google Compute Engine Windows VMs using Google Cloud Ops Agent beginning on Thursday, 2023-02-23 14:14 US/Pacific. Our engineering team is working on a fix and verifying it addresses the issue. We will provide an update by Friday, 2023-04-14 17:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers impacted by this issue may observe high memory usage with GCE Windows VMs using Google Cloud Ops Agent versions >= 2.27.0. Workaround: Affected customers should downgrade to version 2.26.0. Instructions are available: https://cloud.google.com/stackdriver/docs/solutions/agents/ops-agent/troubleshoot-run-ingest#high_memory_usage_on_windows_vms_versions_2270_and_newer |
- All times are US/Pacific