Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I am trying to create a Delta table and it seems the Delta table requires additional permissions on the parent folder of the table. The command failed telling permission errors. I tried to create a parquet table and it works fine.
Delta table is the non-hive compatible format. So there must also be permissions for a client to access the path to the databaseโs location so that it can create a new temporary โdirectoryโ there. This comes from Spark SQLโs handling of external tables. Delta tables just happen to always go through this path.
Delta table is the non-hive compatible format. So there must also be permissions for a client to access the path to the databaseโs location so that it can create a new temporary โdirectoryโ there. This comes from Spark SQLโs handling of external tables. Delta tables just happen to always go through this path.