One of our Databricks notebook (using python, py-spark) has been running long for 12+ hours specifically on the overwrite command into a table. This notebook along with overwrite step has been completed within 10 mins in the past. But suddenly the overwrite step now takes 12+ hours and eventually times out.
There were no cluster changes or anything that would make it run this long. I wanted to see if anyone in the community faced anything similar or would be aware of any recent Databricks bugs/issues.