nayan_wylde
Esteemed Contributor II

1. If you purposely removed _delta_log/ but kept data files.
Delete any remaining _delta_log/ completely, then convert the Parquet directory back to Delta to create a fresh log:

-- path has only Parquet data now
CONVERT TO DELTA parquet.`abfss://<container>@<account>.dfs.core.windows.net/<path>/`

-------------------------------------------------------------------------------------------------------------------------------------

2. Ensure the path is 100% empty (no hidden _delta_log):

# in a Databricks notebook
display(dbutils.fs.ls("abfss://<container>@<account>.dfs.core.windows.net/<path>"))
display(dbutils.fs.ls("abfss://<container>@<account>.dfs.core.windows.net/<path>/_delta_log"))

If anything remains, remove the entire base folder
dbutils.fs.rm("abfss://<container>@<account>.dfs.core.windows.net/<path>", recurse=True)

Then recreate the table

CREATE OR REPLACE TABLE catalog.schema.table
USING DELTA
LOCATION 'abfss://<container>@<account>.dfs.core.windows.net/<path>'
AS SELECT * FROM some_source;