break production using a shallow clone

oosterhuisf
Databricks Partner

Hi,

If you create a shallow clone using the latest LTS, and drop the clone using a SQL warehouse (either current or preview), the source table is broken beyond repair. Data reads and writes still work, but vacuum will remain forever broken. I've attached a notebook that demonstrates this behaviour.

To me it looks like the 'drop table' command in the warehouse does not remove the reference to the source files.

Wanted solution:
* fixed `drop table` in the SQL Warehouse
* working delta table after `repair table`

oosterhuisf
Databricks Partner

To add to that: the manual does not state that this might happen