Incident affecting Virtual Private Cloud (VPC), Google Cloud Networking, Cloud NAT
Virtual Private Cloud public IP packet loss affecting GCE instances in multiple regions
Incident began at 2023-06-06 07:35 and ended at 2023-06-06 08:35 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Singapore (asia-southeast1)Belgium (europe-west1)
| ||6 Jun 2023||14:02 PDT|| |
Mini Incident Report
We apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support .
(All Times US/Pacific)
Impact Window #1:
Impact Window #2:
Impact Window #3:
Affected Services and Features:
Google Cloud Networking - Cloud VPN, Cloud NAT, Virtual Private Cloud (VPC)
Regions/Zones: asia-southeast1, asia-east1, europe-west1
Google Cloud Networking experienced elevated packet loss and latency which impacted multiple Cloud Networking services in asia-southeast1, asia-east1, europe-west1 for a maximum duration of 27 minutes. From preliminary analysis, the root cause was a configuration change for one of the load balancers, which directed traffic for VM public IPs to an incorrect data plane component.
Google Cloud Networking
| ||6 Jun 2023||09:02 PDT|| |
The issue with Virtual Private Cloud (VPC) has been resolved for all affected projects as of Tuesday, 2023-06-06 08:47 US/Pacific.
We thank you for your patience while we worked on resolving the issue.
| ||6 Jun 2023||09:00 PDT|| |
Summary: Virtual Private Cloud public IP packet loss affecting GCE instances in multiple regions
Description: We are experiencing an issue with Virtual Private Cloud (VPC) beginning at Tuesday, 2023-06-06 07:35 US/Pacific.
Our engineering team continues to investigate the issue.
We will provide an update by Tuesday, 2023-06-06 10:06 US/Pacific with current details.
We apologize to all who are affected by the disruption.
Diagnosis: Packet loss when connecting to GCE instances or Network Load Balancers using public IP addresses
Workaround: None at this time.
- All times are US/Pacific