What is the best way to manage the growth of the default storage location?

[Bevin]

What is the best way to manage the growth of the default storage location in a shared workspace? I have a number of users logging in and working on different clusters in a single workspace. I understand that all the results and notebooks are saved to the default storage location. The location seems to grow quite rapidly. The users don't store delta table data in the default location as well.

[karthik_p]

@Bevin Maragh​ Default storage location in the sense, are you talking about hive to store manged data. usually as per recommendation it is also not best practice to store data on DBFS, we need to store everything which is import on /mnt locations please

[Bevin]

Thanks for the reply, I am talking about the default databricks root volume(DBFS ROOT).

https://docs.databricks.com/dbfs/index.html#dbfs-root

I would like to understand best practices related to managing what databricks do with the results outputs of any log info stored in this location etc.

[Anonymous]

Hi @Bevin Maragh​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

[Bevin · Accepted solution]

HI @Vidula Khanna​ 

Yes, thanks, I found this link https://docs.databricks.com/administration-guide/workspace/storage.html , It details how to manage the workspace storage.

[Anonymous]

Hi @Bevin Maragh​ 

Glad to hear that! It's a request that mark an answer as best. It will be highly appreciable.

Thanks and Regards