Creating table in Unity Catalog with file scheme dbfs is not supported

[raktim_das]

code:

# Define the path for the staging Delta table

staging_table_path = "dbfs:/user/hive/warehouse/staging_order_tracking"

spark.sql( f"CREATE TABLE IF NOT EXISTS staging_order_tracking USING DELTA LOCATION '{staging_table_path}'" )

Creating table in Unity Catalog with file scheme dbfs is not supported.

[LuisRSanchez]

In UC dbfs file location and dbfs mount point for a table is consider an anti pattern by databricks, this is because dbfs is at the scope of the workspace and it has security limitations (https://learn.microsoft.com/en-us/azure/databricks/dbfs/unity-catalog)

therefore, use the external location and manage location of UC for table creation.