By guy1234
I ask because when I have recycled nodes in the past, I have seen the pvc enter a state where kubernetes insists that the pv is mounted but it certainly isn’t.
- How to remove a node safely?
- If a pvc goes into this state, how to tell kubernetes it is safe to reset the mount status?
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
Hi there!
There are some race conditions that can impact deployments with volumes that are destroyed or recycled outside of the Cloud Controller Manager. We are working to improve this, but for now you can try this work around.
You can use kubectl get volumeattachment, to get information on what mounts kubernetes believes are active. You can use kubectl describe tog et more information on each. Due to the race conditions mentioned above, sometimes the volumeattachment object that represents a mounted volume is not deleted or stuck in the deletion process. This failure to delete the object makes kubernetes thinks that the volume must still be mounted.
To resolve this issue you need to modify the volumeattachment using:
kubectl edit volumeattachment <volume name>
Then remove the following section from the volume attachment metadata section:
finalizers: external-attacher/dobs-csi-digitalocean-com
This lets Kubernetes run through the rest of the cleanup process, find the volume state correctly and attach it to the new node.
Regards,
John Kwiatkoski Senior Developer Support Engineer
Become a contributor for community
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
DigitalOcean Documentation
Full documentation for every DigitalOcean product.
Resources for startups and AI-native businesses
The Wave has everything you need to know about building a business, from raising funding to marketing your product.
The developer cloud
Scale up as you grow — whether you're running one virtual machine or ten thousand.
Start building today
From GPU-powered inference and Kubernetes to managed databases and storage, get everything you need to build, scale, and deploy intelligent applications.
