strangan
New Contributor II

I had the same issue this morning. I was able to resolve it by running the notebook on a job cluster as opposed to an all purpose interactive cluster. Also best to set it up to not auto scale. These are Databricks recommendations.