Service Health

This page provides status information on the services that are part of Google Cloud. Check back here to view the current status of the services listed below. If you are experiencing an issue not listed here, please contact Support. Learn more about what's posted on the dashboard in this FAQ. For additional information on these services, please visit https://cloud.google.com/.

Incident affecting Google Cloud DNS, Google Cloud Networking

Inbound Forwarding zones may be unreachable

Incident began at 2023-12-04 05:27 and ended at 2023-12-04 20:14 (all times are US/Pacific).

Previously affected location(s)

Global

Date Time Description
4 Dec 2023 20:14 PST

The issue with Google Cloud DNS, Google Cloud Networking has been resolved for all affected users as of Monday, 2023-12-04 19:37 US/Pacific.

We thank you for your patience while we worked on resolving the issue.

4 Dec 2023 18:07 PST

Summary: Inbound Forwarding zones may be unreachable

Description: Our engineering team continues to work on the identified mitigation and is in the midst of completing all the steps and processes necessary for it to be rolled out completely.

At this time, we do not have an ETA for the completion of this roll out.

We understand that this issue has impacted your ability to access and use our services, we deeply appreciate your patience and cooperation while we work to mitigate the issue.

We will provide more information by Monday, 2023-12-04 21:30 US/Pacific.

We sincerely appreciate your patience and understanding as we work to resolve it as quickly as possible.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.

Workaround: * Customers can try moving "Cloud DNS Inbound forwarding" to the non-peered project. However, some customers can't edit their projects.

  • Customers may also be able drain one of their VPN/Interconnect HA shards.
4 Dec 2023 17:45 PST

Summary: Inbound Forwarding zones may be unreachable

Description: Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide more information by Monday, 2023-12-04 19:15 US/Pacific.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.

Workaround: * Customer can try moving "Cloud DNS Inbound forwarding" to the non-peered project. However, some customers can't edit their projects.

  • Customers may also be able drain one of their VPN/Interconnect HA shards.
4 Dec 2023 11:19 PST

Summary: Inbound Forwarding zones may be unreachable

Description: Mitigation work is currently underway by our engineering team.

We do not have an ETA for mitigation at this point.

We will provide more information by Monday, 2023-12-04 19:00 US/Pacific.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.

Workaround: * Customer can try moving "Cloud DNS Inbound forwarding" to the non-peered project. However, some customers can't edit their projects.

  • Customers may also be able drain one of their VPN/Interconnect HA shards.
4 Dec 2023 10:56 PST

Summary: Inbound Forwarding zones may be unreachable

Description: We are experiencing an issue with Google Cloud DNS.

Our engineering teams are still actively investigating the issue. We do not have an ETA of mitigation at this point.

We will provide an update by Monday, 2023-12-04 14:00 US/Pacific with current details.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.

Workaround: * Customer can try moving "Cloud DNS Inbound forwarding" to the non-peered project. However, some customers can't edit their projects.

  • Customers may also be able drain one of their VPN/Interconnect HA shards.
4 Dec 2023 10:43 PST

Summary: Inbound Forwarding zones may be unreachable

Description: We are experiencing an issue with Google Cloud DNS.

Our engineering teams are still actively investigating the issue. We do not have an ETA of mitigation at this point.

We will provide an update by Monday, 2023-12-04 14:00 US/Pacific with current details.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.

Workaround: None at this time.

4 Dec 2023 08:59 PST

Summary: Inbound Forwarding zones may be unreachable

Description: We are experiencing an issue with Google Cloud DNS.

Our engineering teams are actively investigating the issue. We do not have an ETA of mitigation at this point.

We will provide an update by Monday, 2023-12-04 11:00 US/Pacific with current details.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.

Workaround: None at this time.

4 Dec 2023 07:05 PST

Summary: Inbound Forwarding zones may be unreachable

Description: We are experiencing an issue with Google Cloud DNS.

Our engineering teams are actively investigating the issue. We do not have an ETA of mitigation at this point.

We will provide an update by Monday, 2023-12-04 09:00 US/Pacific with current details.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.

Workaround: None at this time.

4 Dec 2023 06:01 PST

Summary: Inbound Forwarding zones may be unreachable

Description: We are experiencing an issue with Google Cloud DNS.

Our engineering team continues to investigate the issue.

We will provide an update by Monday, 2023-12-04 07:15 US/Pacific with current details.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.

Workaround: None at this time.

4 Dec 2023 05:55 PST

Summary: Inbound Forwarding zones may be unreachable

Description: We are experiencing an issue with Google Cloud DNS.

Our engineering team continues to investigate the issue and the regions currently impacted.

We will provide an update by Monday, 2023-12-04 07:00 US/Pacific with current details.

Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied

Workaround: None at this time

4 Dec 2023 05:29 PST

Summary: Inbound Forwarding zones may be unreachable

Description: We are experiencing an issue with Google Cloud DNS.

Our engineering team continues to investigate the issue.

We will provide an update by Monday, 2023-12-04 06:00 US/Pacific with current details.

We apologize to all who are affected by the disruption.

Diagnosis: Impacted users may experience failure in Cloud DNS Forwarding Zones.

Workaround: None at this time