Service Health
Incident affecting Dataplex
High Remote procedure call (RPC) error rate for Data LineageEvents in us-central1
Incident began at 2023-10-21 02:08 and ended at 2023-10-23 04:07 (all times are US/Pacific).
Previously affected location(s)
Iowa (us-central1)
Date | Time | Description | |
---|---|---|---|
| 23 Oct 2023 | 04:07 PDT | The issue with Data Lineage is believed to be affecting a very small number of customers and our Engineering Team is working on it. If you have questions or are impacted, please open a case with the Support Team and we will work with you until this issue is resolved. No further updates will be provided here. We thank you for your patience while we're working on resolving the issue. |
| 22 Oct 2023 | 23:32 PDT | Summary: High Remote procedure call (RPC) error rate for Data LineageEvents in us-central1 Description: Our initial investigation indicates that there has been a delay in the processing of Data LineageEvents created between Thursday, October 19, 2023 at 23:00 US/Pacific and Friday, October 20, 2023 at 09:00 US/Pacific. However, processing of the newly created events are not affected. Our engineering team is continuing to monitor the processing of delayed events while investigating the root cause of the issue. We will provide an update by Tuesday, 2023-10-24 00:00 US/Pacific. We apologize for any inconvenience this has caused. Diagnosis: Data Lineage events created between 2023-10-19 23:00 and 2023-10-20 09:00 US/Pacific have been delayed. Workaround: None at this time |
| 21 Oct 2023 | 03:57 PDT | Summary: High Remote procedure call (RPC) error rate for Data Lineage in us-central1 Description: Our initial investigation indicates that there is a delay in the processing of Lineage events created between Thursday, October 19, 2023 at 23:00 US/Pacific and Friday, October 20, 2023 at 09:00 US/Pacific. Newly created events are not affected. Our engineering team is continuing to monitor the processing of delayed events while investigating the root cause of the issue. We will provide an update by Monday, 2023-10-23 00:00 US/Pacific. We apologize for any inconvenience this may cause. Diagnosis: Data Lineage events created between 2023-10-19 23:00 and 2023-10-20 09:00 US/Pacific are delayed. Workaround: None at this time |
| 21 Oct 2023 | 02:43 PDT | Summary: High Remote procedure call (RPC) error rate for Data Lineage in us-central1 Description: We are experiencing an issue with the Data Lineage feature beginning on Thursday, 2023-10-19 23:00 US/Pacific. Our engineering team continues to investigate the issue. We will provide an update by Saturday, 2023-10-21 04:51 US/Pacific with current details. Diagnosis: Data Lineage events are delayed and events might be missing. Workaround: None at this time |
| 21 Oct 2023 | 02:13 PDT | Summary: Data Lineage unavailable in us-central1 Description: We are experiencing an issue with Data Lineage. Our engineering team continues to investigate the issue. We will provide an update by Saturday, 2023-10-21 02:45 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Impacted users will experience a high error rate when calling Data Lineage API. Workaround: None at this time |
- All times are US/Pacific