Unable to read Delta Table using external tools

oakhill
New Contributor III

I am using the new credential vending API to get tokens and url for my tables in Unity Catalog.

I get the token, url and I am able to scan the folder using read_parquet, but NOT any Delta Lake functions. Not TableExists, scan_delta or delta_scan from Polars or DuckDB.

The table is written using PySpark, and no particular settings.

When reading from Polars:

 

DeltaError: Table metadata is invalid: Number of checkpoint files '0' is not equal to number of checkpoint metadata parts 'None'

 

When reading from DuckDB:

 

IOException: IO Error: Hit DeltaKernel FFI error (from: While trying to read from delta table:

 

 Is there any Databricks-specifics to reading the deltatables?

When reading the _same folder_ using read_parquet, it works.