Service Health
-
-
-
-
Incident affecting Google Compute Engine
The issue with Google Compute Engine VM instance creation and deletion is partially resolved as of 15:14 US/Pacific.
Incident began at 2021-02-18 13:18 and ended at 2021-02-18 16:59 (all times are US/Pacific).
| Date | Time | Description | |
|---|---|---|---|
| | 18 Feb 2021 | 16:59 PST | The issue with Google Compute Engine VM creation and deletion has been resolved for all affected projects as of Thursday, 2021-02-18 16:56 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| | 18 Feb 2021 | 16:45 PST | Description: The issue with Google Compute Engine VM instance creation and deletion is partially resolved. New VM instance creation and deletion requests as of 15:14 US/Pacific should succeed. We are working through a backlog of creation and deletion requests that should complete in the next few hours and users may continue to see issues while we process this backlog. We will provide an update by Thursday, 2021-02-18 18:00 US/Pacific with current details. Diagnosis: Users impacted by this may have been unable to create new instances in us-central1, any products that rely on creating GCE instances in us-central1 as part of a workflow may also have seen an increase in errors. Delete operations may also have experienced latency. Workaround: Retrying operations may succeed. |
| | 18 Feb 2021 | 15:54 PST | Description: We believe the issue with Google Compute Engine VM instance creation and deletion is partially resolved. New VM instance creation requests as of 15:14 US/Pacific should succeed. We are working through a backlog of creation requests that should complete in the next few hours. Current list of known impacted products in us-central1:
Compute Engine We will provide an update by Thursday, 2021-02-18 16:30 US/Pacific with current details. Diagnosis: Users impacted by this may have been unable to create new instances in us-central1, any products that rely on creating GCE instances in us-central1 as part of a workflow may also have seen an increase in errors. Delete operations may also have experienced latency. Workaround: Retrying operations may succeed. |
| | 18 Feb 2021 | 15:11 PST | Description: We are beginning to see recovery from applying the mitigation. We are continuing to monitor and exploring methods of increasing the rate of recovery. Current list of known impacted products in us-central1:
Compute Engine We will provide an update by Thursday, 2021-02-18 15:45 US/Pacific with current details. Diagnosis: Users may be unable to create new instances in us-central1, any products that rely on creating GCE instances in us-central1 as part of a workflow may also see an increase in errors. Delete operations may also experience latency. Workaround: None at this time. |
| | 18 Feb 2021 | 14:51 PST | Description: We are experiencing an issue with Google Compute Engine VM Instance creation in us-central1 beginning at Thursday, 2021-02-18 12:13 US/Pacific. We have begun rolling out a mitigation for the issue and are continuing to monitor. Current list of known impacted products:
Compute Engine We will provide an update by Thursday, 2021-02-18 15:15 US/Pacific with current details. Diagnosis: Users may be unable to create new VMs in us-central1, any products that rely on creating GCE instances in us-central1 as part of a workflow may also see an increase in errors. Workaround: None at this time. |
| | 18 Feb 2021 | 14:17 PST | Description: We are experiencing an issue with Google Compute Engine VM Instance creation in us-central1 beginning at Thursday, 2021-02-18 12:13 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Thursday, 2021-02-18 14:45 US/Pacific with current details. Diagnosis: Users may be unable to create new VMs in us-central1, any products that rely on GCE will be impacted by this. Workaround: None at this time. |
- All times are US/Pacific