We are testing Delta writer in our environment to create bronze tables and recently, I just needed to add one table to the notebook code and rerun the whole notebook that failed because of this error : [DELTA_CREATE_EXTERNAL_TABLE_WITHOUT_TXN_LOG] You are trying to create an external table `urochart-dev`.`qa_trunk`.`audittrail_2025_b` from `abfss://cdc-urochart@spsderlakeland01dev.dfs.core.windows.net/delta-tables-dev/audittrail_2025_b` using Delta, but there is no transaction log present at `abfss://cdc-urochart@spsderlakeland01dev.dfs.core.windows.net/delta-tables-dev/audittrail_2025_b/_delta_log`. Check the upstream job to make sure that it is writing using format("delta") and that the path is the root of the table. To learn more about Delta, see https://docs.microsoft.com/azure/databricks/delta/index SQLSTATE: 42K03
This how the notebook is structure, the first cell is a bunch DROP TABLE table_b statements, then
CREATE EXTERNAL TABLE qa_trunk.audittrail_2025_b using delta location 'abfss://cdc-urochart@spsderlakeland01dev.dfs.core.windows.net/delta-tables-dev/audittrail_2025_b';
I don't if someone here has faced this issue before so I can have some insight. I did a lot researches online but none of it help me fix that.
