Creating table in Unity Catalog with file scheme dbfs is not supported.

shiva123 — Tue, 02 Jul 2024 14:56:58 GMT

Instead, please create a federated data source connection using the CREATE CONNECTION command for the same table provider, then create a catalog based on the connection with a CREATE FOREIGN CATALOG command to reference the tables therein. I am getting this error . I am trying to create a table in Databricks workspace. I don't know How to create a connection for data which is residing in delta lake(s3) . Anyone can give me a code to create a connection and foreign catalog in databricks notebook .Here is my code.

staging_table_path="dbfs:/user/hive/warehouse/staging_order_tracking"

spark.sql(f"create table if not exists staging_order_tracking using delta location '{staging_table_path}'")

Re: Creating table in Unity Catalog with file scheme dbfs is not supported.

daniel_sahal — Wed, 03 Jul 2024 05:02:50 GMT

@shiva123
As the error says, you cannot create a table with DBFS as location.
If you really need to create external table, please follow this guide: https://learn.microsoft.com/en-us/azure/databricks/tables/external

topic Re: Creating table in Unity Catalog with file scheme dbfs is not supported. in Summit 2024

Creating table in Unity Catalog with file scheme dbfs is not supported.

Re: Creating table in Unity Catalog with file scheme dbfs is not supported.