Whenever I tried to execute the cell, it is not executing and it says waiting to run and gets stuck there.
I tried this with different clusters but the problem still persist.
What should be the standard process if I create a new cluster and wants to attach it to the newly created job so that job should run seamlessly?
Hi @Vigneshraja Palaniraj, I am using my own cluster.
Databricks Runtime Version: 11.3 LTS (includes Apache Spark 3.3.0, Scala 2.12)
Unity Catalog enabled.
Worker type: Standard_DS3_v2, 14 GB Memory, 4 Cores
Driver type: Standard_DS3_v2, 14 GB Memory, 4 Cores
Hi @Mahesh Chahare
Hope everything is going great.
Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we can help you.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!