Incident affecting Google Cloud Storage
Global: Google Cloud Storage returns 410 HTTP response when performing resumable uploads
Incident began at 2023-02-09 12:02 and ended at 2023-02-09 13:20 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Tel Aviv (me-west1)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)Santiago (southamerica-west1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)
| ||9 Feb 2023||13:20 PST|| |
The issue with Google Cloud Storage is believed to be affecting a very small number of customers and our engineering team is working on mitigating any identified impact.
If you have questions or are impacted, please open a case with the Support Team and we will work with you until this issue is resolved.
We thank you for your patience while we're working on resolving the issue.
| ||9 Feb 2023||12:22 PST|| |
Summary: Global: Google Cloud Storage intermittently cancels resumable upload operations.
Description: We are experiencing an issue with Google Cloud Storage where customers performing resumable uploads when using CMEK objects will observe intermittent failures.
Our engineering team continues to investigate the issue and working on mitigation of the issue.
We will provide an update by Friday, 2023-02-10 10:00 US/Pacific with current details.
We apologize to all who are affected by the disruption.
Diagnosis: Customers performing resumable uploads may encounter HTTP 503 error when writing a resumable upload chunk. When the client retries, a HTTP 410 response is returned as the result of the upload already being terminated. Only customers using CMEK objects may encounter this issue.
Workaround: None at this time.
- All times are US/Pacific