topic Re: Error not a delta table for Unity Catalog table in Get Started Discussions

Error not a delta table for Unity Catalog table

Stogpon — Mon, 18 Mar 2024 04:17:31 GMT

Is anyone able to advise why I am getting the error not a delta table? The table was created in Unity Catalog. I've also tried DeltaTable.forName and also using 13.3 LTS and 14.3 LTS clusters. Any advice would be much appreciated

Re: Error not a delta table for Unity Catalog table

Stogpon — Mon, 18 Mar 2024 11:52:24 GMT

@Retired_mod the attached screen was using 14.3 LTS cluster. Thanks

Re: Error not a delta table for Unity Catalog table

addy — Tue, 19 Mar 2024 14:52:57 GMT

@StogponI believe if you are using DeltaTable.forPath then you have to pass the path where the table is. You can get this path from the Catalog. It is available in the details tab of the table.

Example:
delta_table_path = "dbfs:/user/hive/warehouse/xyz"

# Read the Delta table using forPath
deltaTable = DeltaTable.forPath(spark, delta_table_path)

The other way would be to use would be DeltaTable.forName(spark, 'tablename')

Hopefully this helps.

Re: Error not a delta table for Unity Catalog table

Stogpon — Tue, 19 Mar 2024 15:22:06 GMT

@addy thanks for your reply. I tried with forName and it's now working. I had tried this both forName and forPath previously with the same error so I'm not sure why it's working now. I can't recall what has changed since whilst I was experimenting/diagnosing. If I experience it again I'll have to take closer notes of the steps I took to reach that step. Anyhow thanks for your help, it's much appreciated.