Creating table in Unity Catalog with file scheme dbfs is not supported.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-02-2024 07:56 AM
Creating table in Unity Catalog with file scheme dbfs is not supported.
Instead, please create a federated data source connection using the CREATE CONNECTION command for the same table provider, then create a catalog based on the connection with a CREATE FOREIGN CATALOG command to reference the tables therein. I am getting this error . I am trying to create a table in Databricks workspace. I don't know How to create a connection for data which is residing in delta lake(s3) . Anyone can give me a code to create a connection and foreign catalog in databricks notebook .Here is my code.
staging_table_path="dbfs:/user/hive/warehouse/staging_order_tracking"
spark.sql(f"create table if not exists staging_order_tracking using delta location '{staging_table_path}'")
