https://community.databricks.com/t5/data-engineering/expected-size-of-managed-storage-accounts/m-p/65385#M32795 <P>Dear all,</P><P>we are monitoring the size of managed storage accounts associated with our deployed Azure databricks instances.</P><P>We have 5 databricks instances for specific components of our platform replicated in 4 environments (DEV, TEST, PREPROD, PROD).</P><P>During our analysis we observed Storage Account sizes ranging from some MBytes to a couple of TBytes. Note, that we do not store any production tables on managed storage accounts nor do we upload any form of data. Production instances usually have the larger volume.</P><P>Note, that the size is comparable to our production tables (some TBytes).</P><P>Our main questions are:</P><OL><LI>What do these Storage Accounts contain?</LI><LI>What is the best way to reduce the size?</LI><LI>How can we manually delete not important (e.g. logs) files?</LI><LI>Can we automate the process on #3?</LI></OL><P>Thanks a lot,</P><P>Kind regards,<BR />The European Dynamics team</P> Wed, 03 Apr 2024 10:43:54 GMT EDDatabricks 2024-04-03T10:43:54Z https://community.databricks.com/t5/data-engineering/expected-size-of-managed-storage-accounts/m-p/65385#M32795 <P>Dear all,</P><P>we are monitoring the size of managed storage accounts associated with our deployed Azure databricks instances.</P><P>We have 5 databricks instances for specific components of our platform replicated in 4 environments (DEV, TEST, PREPROD, PROD).</P><P>During our analysis we observed Storage Account sizes ranging from some MBytes to a couple of TBytes. Note, that we do not store any production tables on managed storage accounts nor do we upload any form of data. Production instances usually have the larger volume.</P><P>Note, that the size is comparable to our production tables (some TBytes).</P><P>Our main questions are:</P><OL><LI>What do these Storage Accounts contain?</LI><LI>What is the best way to reduce the size?</LI><LI>How can we manually delete not important (e.g. logs) files?</LI><LI>Can we automate the process on #3?</LI></OL><P>Thanks a lot,</P><P>Kind regards,<BR />The European Dynamics team</P> Wed, 03 Apr 2024 10:43:54 GMT https://community.databricks.com/t5/data-engineering/expected-size-of-managed-storage-accounts/m-p/65385#M32795 EDDatabricks 2024-04-03T10:43:54Z https://community.databricks.com/t5/data-engineering/expected-size-of-managed-storage-accounts/m-p/71768#M34392 <P>seems not a relevant ans, as question is about databricks managed storage account...</P> Wed, 05 Jun 2024 13:46:04 GMT https://community.databricks.com/t5/data-engineering/expected-size-of-managed-storage-accounts/m-p/71768#M34392 ankurjainyash 2024-06-05T13:46:04Z