Service Health
-
-
-
-
Incident affecting Cloud Filestore
File access issues for non-root users for Cloud Filestore
Incident began at 2023-02-25 18:24 and ended at 2023-03-01 03:05 (all times are US/Pacific).
Previously affected location(s)
Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Delhi (asia-south2)Singapore (asia-southeast1)Sydney (australia-southeast1)Warsaw (europe-central2)Finland (europe-north1)Belgium (europe-west1)London (europe-west2)Frankfurt (europe-west3)Zurich (europe-west6)Paris (europe-west9)Tel Aviv (me-west1)Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)South Carolina (us-east1)Northern Virginia (us-east4)Oregon (us-west1)Los Angeles (us-west2)Las Vegas (us-west4)
| Date | Time | Description | |
|---|---|---|---|
| | 1 Mar 2023 | 03:05 PST | The issue with Cloud Filestore has been resolved for all affected users as of Wednesday, 2023-03-01 01:56 US/Pacific. We thank you for your patience while we worked on resolving the issue. |
| | 28 Feb 2023 | 08:00 PST | Summary: File access issues for non-root users for Cloud Filestore Description: Mitigation work is still underway by our engineering team. The mitigation is expected to complete by Wednesday, 2023-03-01 03:00 US/Pacific. We will provide more information by Wednesday, 2023-03-01 03:00 US/Pacific. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). 3. Contact support to initiate an upgrade of the affected instance. |
| | 27 Feb 2023 | 22:21 PST | Summary: File access issues for non-root users for Cloud Filestore Description: We are experiencing an issue with Cloud Filestore Enterprise and High Scale tiers. Mitigation work is still underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Tuesday, 2023-02-28 10:30 US/Pacific. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). 3. Contact support to initiate an upgrade of the affected instance. |
| | 27 Feb 2023 | 10:31 PST | Summary: File access issues for non-root users for Cloud Filestore Description: We are experiencing an issue with Cloud Filestore Enterprise and High Scale tiers. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Monday, 2023-02-27 22:30 US/Pacific. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). 3. Contact support to initiate an upgrade of the affected instance. |
| | 27 Feb 2023 | 08:15 PST | Summary: File access issues for non-root users for Cloud Filestore Description: We are experiencing an issue with Cloud Filestore Enterprise and High Scale tiers. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Monday, 2023-02-27 10:30 US/Pacific. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). 3. Contact support to initiate an upgrade of the affected instance. |
| | 26 Feb 2023 | 07:09 PST | Summary: File access issues for non-root users for Cloud Filestore Description: We are experiencing an issue with Cloud Filestore Enterprise and High Scale tiers. Mitigation work is currently underway by our engineering team. We do not have an ETA for mitigation at this point. We will provide more information by Monday, 2023-02-27 08:30 US/Pacific. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). 3. Contact support to initiate an upgrade of the affected instance. |
| | 26 Feb 2023 | 06:28 PST | Summary: File access issues for non-root users for Cloud Filestore Description: We are experiencing an issue with Cloud Filestore Enterprise and High Scale tiers. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-02-26 08:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). |
| | 26 Feb 2023 | 03:01 PST | Summary: File access issues for non-root users for Cloud Filestore Description: We are experiencing an issue with Cloud Filestore Enterprise and High Scale tiers. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-02-26 06:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). |
| | 26 Feb 2023 | 01:15 PST | Summary: File access issues for non-root users for Cloud Filestore Description: We are experiencing an issue with Cloud Filestore Enterprise and High Scale tiers. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-02-26 03:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). 3. Contact support to initiate rollback of the affected instance, with a potential instance downtime |
| | 26 Feb 2023 | 00:08 PST | Summary: File access issues for non-root users for Cloud Filestore Description: We are experiencing an issue with Cloud Filestore Enterprise and High Scale tiers. Our engineering team continues to investigate the issue. We will provide an update by Sunday, 2023-02-26 01:30 US/Pacific with current details. We apologize to all who are affected by the disruption. Diagnosis: Non-root users may observe "Operation not permitted" access denied while accessing the files with the access is only granted via group permissions. Workaround: 1. Change the file owner to match the user accessing the file. 2. Alternatively, access the file as the superuser (root user). 3. Contact support to initiate rollback of the affected instance, with a potential instance downtime |
- All times are US/Pacific