Service Health
Incident affecting Cloud Developer Tools, Artifact Registry
Artifact Registry is returning 500 errors for API calls to download binary large object (blob) images
Incident began at 2023-10-18 06:53 and ended at 2023-10-18 12:51 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)Berlin (europe-west10)Turin (europe-west12)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Doha (me-central1)Dammam (me-central2)Tel Aviv (me-west1)Montréal (northamerica-northeast1)São Paulo (southamerica-east1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)
Date | Time | Description | |
---|---|---|---|
| 18 Oct 2023 | 12:51 PDT | The issue with Artifact Registry has been resolved for all affected projects as of Wednesday, 2023-10-18 12:39 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| 18 Oct 2023 | 11:47 PDT | Summary: Artifact Registry is returning 500 errors for API calls to download binary large object (blob) images Description: Mitigation work is currently underway by our engineering team. We have partially mitigated the incident. A full mitigation will roll out over the next 8 hours. We are working to accelerate this timetable. We will provide more information by Wednesday, 2023-10-18 20:00 US/Pacific. Diagnosis: Artifact Registry returns 500 errors for API calls to download blob (binary large object) images. Workaround: Customers’ can retry the API calls as a temporary measure while our engineering teams are working on a permanent mitigation. |
| 18 Oct 2023 | 11:01 PDT | Summary: Artifact Registry is returning 500 errors for API calls to download binary large object (blob) images Description: Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Wednesday, 2023-10-18 12:00 US/Pacific. Diagnosis: Artifact Registry returns 500 errors for API calls to download blob (binary large object) images. Workaround: Customers’ can retry the API calls as a temporary measure while our engineering teams are working on a permanent mitigation. |
| 18 Oct 2023 | 09:56 PDT | Summary: Artifact Registry is returning 500 errors for API calls to download binary large object (blob) images Description: We are experiencing an issue with the Artifact Registry beginning on Monday, 2023-10-16 19:55 US/Pacific. Our engineering team continues to investigate the issue. We have identified a recent change that we suspect to be causing the issue. Our engineering teams are working to rollback the change as part of mitigation efforts. We will provide an update by Wednesday, 2023-10-18 11:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Artifact Registry returns 500 errors for API calls to download blob (binary large object) images. Workaround: Customers’ can retry the API calls as a temporary measure while our engineering teams are working on a permanent mitigation. |
| 18 Oct 2023 | 09:19 PDT | Summary: Artifact Registry is returning 500 errors for API calls to download binary large object (blob) images Description: We are experiencing an issue with Artifact Registry beginning at Monday, 2023-10-16 19:55 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Wednesday, 2023-10-18 10:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Artifact Registry returns 500 errors for API calls to download blob (binary large object) images. Workaround: Customers’ can retry the API calls as a temporary measure while our engineering teams are working on a permanent mitigation. |
| 18 Oct 2023 | 08:56 PDT | Summary: Artifact Registry is returning 500 errors for API calls to download binary large object (blob) images Description: We are experiencing an issue with Artifact Registry beginning at Monday, 2023-10-16 19:55 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Wednesday, 2023-10-18 10:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Artifact Registry returns 500 errors for API calls to download blob (binary large object) images. Workaround: None at this time. |
- All times are US/Pacific