topic Re: Creating table in Unity Catalog with file scheme dbfs is not supported in Get Started Discussions

Creating table in Unity Catalog with file scheme dbfs is not supported

raktim_das — Thu, 13 Jun 2024 08:31:54 GMT

code:

# Define the path for the staging Delta table

staging_table_path = "dbfs:/user/hive/warehouse/staging_order_tracking"

spark.sql( f"CREATE TABLE IF NOT EXISTS staging_order_tracking USING DELTA LOCATION '{staging_table_path}'" )

Creating table in Unity Catalog with file scheme dbfs is not supported.

Re: Creating table in Unity Catalog with file scheme dbfs is not supported

LuisRSanchez — Fri, 14 Jun 2024 15:22:59 GMT

In UC dbfs file location and dbfs mount point for a table is consider an anti pattern by databricks, this is because dbfs is at the scope of the workspace and it has security limitations (https://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog)

therefore, use the external location and manage location of UC for table creation.

Re: Creating table in Unity Catalog with file scheme dbfs is not supported

SaiPrakash_653 — Mon, 30 Dec 2024 07:16:51 GMT

I believe, using mount point only we can able to connect to our storage account - containers. If this is anti pattern by data bricks what is the way? Can you please explain what is external location of UC is it our local system folders or something new that I need to know. Please explain me I am very new to the data bricks.