Service Health
Incident affecting Cloud Developer Tools
Increased error rate of high latency for Google Container Registry API calls
Incident began at 2018-09-04 02:55 and ended at 2018-09-04 12:50 (all times are US/Pacific).
Date | Time | Description | |
---|---|---|---|
| 7 Sep 2018 | 20:06 PDT | A detailed analysis has been written for this incident and is available at cloud storage incident 18003: https://status.cloud.google.com/incident/storage/18003 |
| 4 Sep 2018 | 16:11 PDT | The issue with the Google Container Registry API experiencing increased latency has been resolved for all affected users as of Tuesday, 2018-09-04 12:52 US/Pacific. We will conduct an internal investigation of this issue and make appropriate improvements to our systems to help prevent or minimize future recurrence. |
| 4 Sep 2018 | 14:25 PDT | The issue with Google Container Registry API latency should be resolved for the majority of requests Remaining high latency is believed to be affecting less than 1% of requests. Mitigation for full resolution is ongoing. We will provide another status update by Tuesday, 2018-09-04 16:30 US/Pacific with current details. |
| 4 Sep 2018 | 12:52 PDT | The issue with Google Container Registry API latency should be mitigated for the majority of requests and we expect a full resolution in the near future. We will provide another status update by Tuesday, 2018-09-04 14:30 US/Pacific with current details. |
| 4 Sep 2018 | 11:01 PDT | Temporary mitigation efforts have significantly reduced the error rate but we are still seeing intermittent errors or latency on requests. Full resolution efforts are still ongoing. We will provide another status update by Tuesday, 2018-09-04 13:00 US/Pacific with current details. |
| 4 Sep 2018 | 09:40 PDT | The rate of errors is decreasing. We will provide another status update by Tuesday, 2018-09-04 11:15 US/Pacific with current details. |
| 4 Sep 2018 | 08:21 PDT | Mitigation work is currently underway by our Engineering Team. We will provide another status update by Tuesday, 2018-09-04 09:45 US/Pacific with current details. |
| 4 Sep 2018 | 07:30 PDT | We are experiencing an issue with Google Container Registry API calls failing intermittently beginning at Tuesday, 2018-09-04 06:32 US/Pacific. Current data indicate that approximately 15% of requests in US region are affected by this issue and 6% of image pulls. For everyone who is affected, we apologize for the disruption. We will provide an update by Tuesday, 2018-09-04 08:30 US/Pacific with current details. |
| 4 Sep 2018 | 06:55 PDT | We are experiencing an issue with Google Container Registry API calls failing intermittently beginning at Tuesday, 2018-09-04 06:32 US/Pacific. Current data indicate that approximately 15% of requests in US region are affected by this issue. For everyone who is affected, we apologize for the disruption. We will provide an update by Tuesday, 2018-09-04 07:30 US/Pacific with current details. |
| 4 Sep 2018 | 06:55 PDT | Increased error rate of high latency for Google Container Registry API calls |
- All times are US/Pacific