Service Health
Incident affecting Vertex Gemini API
An issue with Vertex Gemini API in multiple regions of Asia and America
Incident began at 2024-11-13 07:51 and ended at 2024-11-18 02:29 (all times are US/Pacific).
Previously affected location(s)
Tokyo (asia-northeast1)Seoul (asia-northeast3)Mumbai (asia-south1)Singapore (asia-southeast1)Sydney (australia-southeast1)Iowa (us-central1)Northern Virginia (us-east4)Oregon (us-west1)Las Vegas (us-west4)
Date | Time | Description | |
---|---|---|---|
| 18 Nov 2024 | 02:29 PST | The issue with Vertex Gemini API has been resolved for all affected users as of Monday, 2024-11-18 02:29 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| 15 Nov 2024 | 17:21 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: Mitigation work is still underway by our engineering team, and error rates and latency are showing continued improvement. We do not have an ETA for full mitigation at this point. We will provide more information by Monday, 2024-11-18 11:00 US/Pacific. Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
| 15 Nov 2024 | 11:59 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: Mitigation work is still underway by our engineering team, and error rates and latency are showing continued improvement. We do not have an ETA for full mitigation at this point. We will provide more information by Friday, 2024-11-15 17:30 US/Pacific. Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
| 15 Nov 2024 | 09:51 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: Mitigation work is still underway by our engineering team, and error rates and latency are showing improvement. We will provide more information by Friday, 2024-11-15 12:30 US/Pacific. Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
| 15 Nov 2024 | 06:34 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: Mitigation work is currently underway by our engineering team. Mitigation activities are still ongoing at this point. We will provide more information by Friday, 2024-11-15 10:00 US/Pacific. Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
| 15 Nov 2024 | 05:08 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Friday, 2024-11-15 07:00 US/Pacific. Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
| 15 Nov 2024 | 04:48 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: We are experiencing an intermittent issue with Vertex Gemini API beginning at Wednesday, 2024-11-13 03:21 US/Pacific. While our engineering team continues to investigate the issue, please reach out to Google Cloud Support if you need assistance. We will provide an update by Friday, 2024-11-15 06:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
| 15 Nov 2024 | 03:42 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: We are experiencing an intermittent issue with Vertex Gemini API beginning at Wednesday, 2024-11-13 03:21 US/Pacific. While our engineering team continues to investigate the issue, please reach out to Google Cloud Support if you need assistance. We will provide an update by Friday, 2024-11-15 06:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
| 15 Nov 2024 | 03:38 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: We are experiencing an intermittent issue with Vertex Gemini API beginning at Wednesday, 2024-11-13 03:21 US/Pacific. While our engineering team continues to investigate the issue, please reach out to Google Cloud Support if you need assistance. We will provide an update by Friday, 2024-11-15 06:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Users impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with either 100% errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
| 14 Nov 2024 | 23:39 PST | Summary: An issue with Vertex Gemini API in multiple regions of Asia and America Description: We are experiencing an intermittent issue with Vertex Gemini API beginning at Wednesday, 2024-11-13 03:21 US/Pacific. While our engineering team continues to investigate the issue, please reach out to Google Cloud Support if you need assistance. We will provide an update by Friday, 2024-11-15 04:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Users impacted by this issue may observe long context requests to Gemini 1.5 Pro 002 are served with either 100% errors or extremely long latency in some clusters in the impacted regions. Workaround: The impacted users may try using the Europe based regions to use the Vertex Gemini API configurations or operations. |
- All times are US/Pacific