I am using the new credential vending API to get tokens and url for my tables in Unity Catalog.
I get the token, url and I am able to scan the folder using read_parquet, but NOT any Delta Lake functions. Not TableExists, scan_delta or delta_scan from Polars or DuckDB.
The table is written using PySpark, and no particular settings.
When reading from Polars:
DeltaError: Table metadata is invalid: Number of checkpoint files '0' is not equal to number of checkpoint metadata parts 'None'
When reading from DuckDB:
IOException: IO Error: Hit DeltaKernel FFI error (from: While trying to read from delta table:
Is there any Databricks-specifics to reading the deltatables?
When reading the _same folder_ using read_parquet, it works.