Service Health
Incident affecting Document AI, Cloud Machine Learning
Document AI availability has stabilized in Multi-region: us.
Incident began at 2023-12-04 15:31 and ended at 2023-12-05 09:57 (all times are US/Pacific).
Previously affected location(s)
Multi-region: us
Date | Time | Description | |
---|---|---|---|
| 5 Dec 2023 | 09:57 PST | Document AI availability has stabilized for all affected users as of Tuesday, 2023-12-05 09:03 US/Pacific. We apologize to all who are affected by the disruption. |
| 5 Dec 2023 | 09:29 PST | Summary: Document AI is experiencing a degradation in availability in Multi-region: us. We have identified the root cause and are working urgently to resolve it. Description: Document AI is experiencing a degradation in availability in Multi-region: us. We have identified the root cause of the issue and are taking next steps to resolve it. We estimate the service will be restored by Dec 5, 2023. We will provide an update by Tuesday, 2023-12-05 10:30 US/Pacific. We apologize to all who are affected by the disruption. Diagnosis: Customers using Document AI to process documents with DocumentProcessorService-ProcessDocument API using v1, v1beta3 or uiv1beta3 versions may observe the following errors: Error1: HTTP Mapping: 499 Client Closed Request (CANCELLED); Error2: HTTP Mapping: 504 Gateway Timeout (DEADLINE_EXCEEDED) Workaround: Process the volume in a different region by creating a processor in a new region and importing the desired processor version as explained in the below documentation. https://cloud.google.com/document-ai/docs/create-processor https://cloud.google.com/document-ai/docs/manage-processor-versions#import |
| 4 Dec 2023 | 21:17 PST | Summary: Document AI is experiencing a degradation in availability in Multi-region: us. We have identified the root cause and are working urgently to resolve it. Description: Document AI is experiencing a degradation in availability in Multi-region: us. We have identified the root cause of the issue and are taking next steps to resolve it. We estimate the service will be restored by Dec 5, 2023. We will provide an update by Tuesday, 2023-12-05 09:30 US/Pacific. We apologize to all who are affected by the disruption. Diagnosis: Customers using Document AI to process documents with DocumentProcessorService-ProcessDocument API using v1, v1beta3 or uiv1beta3 versions may observe the following errors: Error1: HTTP Mapping: 499 Client Closed Request (CANCELLED); Error2: HTTP Mapping: 504 Gateway Timeout (DEADLINE_EXCEEDED) Workaround: Process the volume in a different region by creating a processor in a new region and importing the desired processor version as explained in the below documentation. https://cloud.google.com/document-ai/docs/create-processor https://cloud.google.com/document-ai/docs/manage-processor-versions#import |
| 4 Dec 2023 | 18:14 PST | Summary: Document AI is experiencing a degradation in availability in Multi-region: us. We have identified the root cause and are urgently working to resolve it. Description: Document AI is experiencing a degradation in availability in the Multi-region: us. We have identified the root cause of the issue and are taking next steps to resolve it. We estimate the service will be restored by Dec 5, 2023. We will provide an update by Tuesday, 2023-12-05 09:30 US/Pacific. We apologize to all who are affected by the disruption. Diagnosis: Customers using Document AI to process documents with DocumentProcessorService-ProcessDocument API using v1, v1beta3 or uiv1beta3 versions may observe the following errors: Error1: HTTP Mapping: 499 Client Closed Request (CANCELLED); Error2: HTTP Mapping: 504 Gateway Timeout (DEADLINE_EXCEEDED) Workaround: Process the volume in a different region by creating a processor in a new region and importing the desired processor version as explained in the below documentation. https://cloud.google.com/document-ai/docs/create-processor https://cloud.google.com/document-ai/docs/manage-processor-versions#import |
| 4 Dec 2023 | 16:25 PST | Summary: We've received a report of an issue with Document AI in us multiregion Description: We are experiencing an issue with Document AI beginning on Monday, 2023-12-04 13:00 US/Pacific. Our engineering team continues to investigate and work towards mitigating the issue. At this time, we do not have a specific ETA for the mitigation work to be completed. Please rest assured that our engineering teams are working diligently to mitigate all known impacts. We understand that this issue has impacted your ability to access and use our services, we deeply appreciate your patience and cooperation while we worked to mitigate the issue We will provide an update by Monday, 2023-12-04 18:30 US/Pacific with current details. Diagnosis: Customers using Document AI to process documents with 'DocumentProcessorService-ProcessDocument' API using v1, v1beta3 or uiv1beta3 versions may observe the following errors. Error1: HTTP Mapping: 499 Client Closed Request (CANCELLED); Error2: HTTP Mapping: 504 Gateway Timeout (DEADLINE_EXCEEDED) Workaround: There is no known workaround at this time. |
| 4 Dec 2023 | 15:31 PST | Summary: We've received a report of an issue with Document AI in us multiregion Description: We are experiencing an issue with Document AI beginning at Monday, 2023-12-04 13:00 US/Pacific. Mitigation work is currently underway by our engineering team. Our engineering team continues to investigate the issue. We will provide an update by Monday, 2023-12-04 16:30 US/Pacific with current details. Diagnosis: Customers using Document AI to process documents with 'DocumentProcessorService-ProcessDocument' API using v1, v1beta3 or uiv1beta3 versions may observe the following errors. Error1: HTTP Mapping: 499 Client Closed Request (CANCELLED); Error2: HTTP Mapping: 504 Gateway Timeout (DEADLINE_EXCEEDED) Workaround: There is no known workaround at this time. |
- All times are US/Pacific