Display, count and write commands stuck after 1st job

magy
New Contributor

Hi,

I have problems with displaying and saving a table in Databricks.

Simple command can run for hours without any progress..

imageBefore that I am not doing any rocket science - code runs in less than a minute, I have one join at the end.

I am using 7.3 LTS ML GPU cluster with Standard_NC12 worker and driver.

Dataset has around 3 mln rows.

Thanks in advance for any help!