raphaelblg
Databricks Employee
Databricks Employee

Hi @claudiazi,

It's hard to determine the exact root cause of the issue, but there's a known issue that could lead to the same error. 

If you check CREATE TABLE [USING] - Parameters. You'll be able to see the following note:

 

Databricks strongly recommends using REPLACE instead of dropping and re-creating Delta Lake tables.

This is because the pattern of deleting and creating Delta Lake tables without the REPLACE clause might not clean-up all the metadata files right away. 

 

Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks