https://community.databricks.com/t5/data-engineering/how-to-disable-dbfs-storage/m-p/73328#M34644 <P>Hello,<BR /><SPAN>I administer a self-service oriented Databricks workspace and I notice that more and more users are storing their data in DBFS due to lack of knowledge.<BR /></SPAN><SPAN>They are not specifying a location when creating their schema or they are not specifying a schema at all.</SPAN></P><P><SPAN>To prevent them from doing so, I thought about adding a parameter in spark config : "spark.sql.warehouse.dir adl://forbidden ".</SPAN></P><P><SPAN>It works pretty well ... except when we add a location on a table.<BR />Why it's trying to use "spark.sql.warehouse.dir" for that ?</SPAN></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="MaximeGendre_1-1718227315313.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/8396iAD2CD63B2851937B/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="MaximeGendre_1-1718227315313.png" alt="MaximeGendre_1-1718227315313.png" /></span></P><P>Is there another way to block DBFS usage ?</P><P>PS : I know that Unity Catalog should solve this problem but it will deployed only in few months.</P><P>Thank you.</P><P>&nbsp;</P> Wed, 12 Jun 2024 21:27:37 GMT MaximeGendre 2024-06-12T21:27:37Z https://community.databricks.com/t5/data-engineering/how-to-disable-dbfs-storage/m-p/73328#M34644 <P>Hello,<BR /><SPAN>I administer a self-service oriented Databricks workspace and I notice that more and more users are storing their data in DBFS due to lack of knowledge.<BR /></SPAN><SPAN>They are not specifying a location when creating their schema or they are not specifying a schema at all.</SPAN></P><P><SPAN>To prevent them from doing so, I thought about adding a parameter in spark config : "spark.sql.warehouse.dir adl://forbidden ".</SPAN></P><P><SPAN>It works pretty well ... except when we add a location on a table.<BR />Why it's trying to use "spark.sql.warehouse.dir" for that ?</SPAN></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="MaximeGendre_1-1718227315313.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/8396iAD2CD63B2851937B/image-size/medium/is-moderation-mode/true?v=v2&amp;px=400" role="button" title="MaximeGendre_1-1718227315313.png" alt="MaximeGendre_1-1718227315313.png" /></span></P><P>Is there another way to block DBFS usage ?</P><P>PS : I know that Unity Catalog should solve this problem but it will deployed only in few months.</P><P>Thank you.</P><P>&nbsp;</P> Wed, 12 Jun 2024 21:27:37 GMT https://community.databricks.com/t5/data-engineering/how-to-disable-dbfs-storage/m-p/73328#M34644 MaximeGendre 2024-06-12T21:27:37Z https://community.databricks.com/t5/data-engineering/how-to-disable-dbfs-storage/m-p/73949#M34685 <P>Replacing "/mnt/adl2" by "dbfs:/mnt/adl2" fixed the issue.</P> Thu, 13 Jun 2024 21:42:43 GMT https://community.databricks.com/t5/data-engineering/how-to-disable-dbfs-storage/m-p/73949#M34685 MaximeGendre 2024-06-13T21:42:43Z