Service Health
Incident affecting Vertex Gemini API
Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002
Incident began at 2025-01-07 13:28 and ended at 2025-01-07 21:18 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Seoul (asia-northeast3)Mumbai (asia-south1)Singapore (asia-southeast1)Sydney (australia-southeast1)Warsaw (europe-central2)Finland (europe-north1)Madrid (europe-southwest1)Belgium (europe-west1)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Milan (europe-west8)Paris (europe-west9)Doha (me-central1)Dammam (me-central2)Tel Aviv (me-west1)Montréal (northamerica-northeast1)São Paulo (southamerica-east1)Iowa (us-central1)South Carolina (us-east1)Northern Virginia (us-east4)Columbus (us-east5)Dallas (us-south1)Oregon (us-west1)Las Vegas (us-west4)
Date | Time | Description | |
---|---|---|---|
| 7 Jan 2025 | 21:18 PST | The issue with Vertex Gemini API has been resolved for all affected users as of Tuesday, 2025-01-07 21:18 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| 7 Jan 2025 | 20:24 PST | Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Gemini 1.5 Flash - Steady progress is being made with the recovery process, while the Engineering team continues to ensure that recurrence of errors are prevented. Gemini 1.5 Pro 002 - Engineering is working on the final instance where mitigation is being applied. Error rates have reduced to ~1-3%, and are expected to return to normalcy post complete mitigation. We will provide an update by Tuesday, 2025-01-07 23:30 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time. |
| 7 Jan 2025 | 19:29 PST | Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Gemini 1.5 Flash - Steady progress is being made with the recovery process, while the Engineering team continues to ensure that recurrence of errors are prevented. Gemini 1.5 Pro 002 - Engineering is working on the final instance where mitigation is being applied. Error rates have reduced to ~1-3%, and are expected to return to normalcy post complete mitigation. We will provide an update by Tuesday, 2025-01-07 21:00 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time. |
| 7 Jan 2025 | 18:17 PST | Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Gemini 1.5 Flash - Our engineering team continues to work steadily towards mitigation. Gemini 1.5 Pro 002 - A majority of the mitigation efforts have been successfully completed and a drastic improvement has been confirmed in the success rates for requests. We will provide an update by Tuesday, 2025-01-07 19:30 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time. |
| 7 Jan 2025 | 16:47 PST | Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Our engineering team has identified a potential mitigation strategy and is in the process of executing the same. Subsequently, a drop in the number of ‘500’ errors has been observed. We will provide an update by Tuesday, 2025-01-07 18:00 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time. |
| 7 Jan 2025 | 15:30 PST | Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash and Gemini 1.5 Pro 002 Description: We are experiencing an intermittent issue with Vertex Gemini API. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2025-01-07 16:30 US/Pacific with current details. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time. |
| 7 Jan 2025 | 14:51 PST | Summary: Elevated rate of ‘500’ errors observed on Gemini 1.5 Flash Description: We are experiencing an intermittent issue with Vertex Gemini API. Our engineering team continues to investigate the issue. We will provide an update by Tuesday, 2025-01-07 16:00 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Customers impacted by this issue may see intermittent ‘500’ error messages. Workaround: None at this time. |
- All times are US/Pacific