Thanks! We are now able to see the debug logs and the code is progressing further than before.

Schema fetch is working successfully for both Synapse and Databricks. However, the Spark jobs are getting stuck with:

• 0 rows read

• 0 bytes read

• 0 bytes written

The notebook cell keeps running continuously without completing.

We are using:

• an all-purpose cluster

• report_type = row

• and the table contains only around 1000 rows

Has anyone seen Spark jobs remain in this state during Lakebridge reconciliation?

Any suggestions on possible causes or debugging steps would be very helpful.

Thanks!