Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
When deleting a workspace from the Databricks Accounts Console, I noticed the AWS resources (VPC, NAT, etc.) are not removed. Should they be? And if not, is there a clean/simple way of cleaning up the residual AWS resources?
Hi @Brad Franklinโ , from my knowledge I would say there is no such option in Databricks to clean up the resources. The reason is there are possibilities that the VPC could be shared by other resources. If deleting Databricks workspace cleans the AWS resources, then the shared resources will be broken. To avoid such inconvenience this is not available. You might need to manually do a cleanup.
Hi @Brad Franklinโ , from my knowledge I would say there is no such option in Databricks to clean up the resources. The reason is there are possibilities that the VPC could be shared by other resources. If deleting Databricks workspace cleans the AWS resources, then the shared resources will be broken. To avoid such inconvenience this is not available. You might need to manually do a cleanup.
Thank you Prabakar - that's what I figured but didn't know if there was documentation on resource cleanup. I'll just go through and find everything the CF stack created and remove them.
Regards,
Brad
Connect with Databricks Users in Your Area
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
