Google Cloud Service Health

Google Cloud Service Health
Incidents
Vertex AI Search: Delays in Retail Search model training

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Available
Service information
Service disruption
Service outage

Incident affecting Recommendation AI, Cloud Machine Learning

Vertex AI Search: Delays in Retail Search model training

Incident began at 2024-01-11 10:26 and ended at 2024-01-11 15:19 (all times are US/Pacific).

Previously affected location(s)

Global

Date	Time	Description
11 Jan 2024	15:19 PST	The issue with Recommendation AI, Vertex AI Search has been resolved as of Thursday, 2024-01-11 14:50 US/Pacific. We understand that this issue had impacted your ability to access and use our services, we deeply appreciate your patience and cooperation while we worked to mitigate the issue. Thank you for choosing us.
11 Jan 2024	14:06 PST	Summary: Vertex AI Search: Retail Search model training delayed Description: Engineers have partially mitigated the issue. At this time Retail Search model training has resumed for new events. Existing, unprocessed events are also processing, however this is likely to take some time to complete. We do not have an ETA for full resolution at this point. We will provide an update by Friday, 2024-01-12 13:00 US/Pacific with current details. Diagnosis: Retail Search model training may be delayed or stopped. Workaround: None at this time.
11 Jan 2024	13:50 PST	Summary: Vertex AI Search: Retail Search model training delayed Description: Mitigation work remains underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Thursday, 2024-01-11 17:00 US/Pacific. Diagnosis: Retail Search model training may be delayed or stopped. Workaround: None at this time.
11 Jan 2024	12:06 PST	Summary: Vertex AI Search: Retail Search model training delayed Description: Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Thursday, 2024-01-11 14:00 US/Pacific. Diagnosis: Retail Search model training may be delayed or stopped. Workaround: None at this time.
11 Jan 2024	11:07 PST	Summary: Vertex AI Search: Retail Search model training delayed Description: Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Thursday, 2024-01-11 12:15 US/Pacific. Diagnosis: Retail Search model training may be delayed or stopped. Workaround: None at this time.
11 Jan 2024	10:48 PST	Summary: Vertex AI Search: Retail Search model training delayed Description: We are experiencing an issue with Recommendation AI, Vertex AI Search. Our engineering team continues to investigate the issue. We will provide an update by Thursday, 2024-01-11 12:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Retail Search model training may be delayed or stopped. Workaround: None at this time.

All times are US/Pacific