Hi Team,
Hi Team,
Is it feasible to run pyspark cells concurrently in databricks notebooks? If so, kindly provide instructions on how to accomplish this. We aim to execute the intermediate steps simultaneously.
The given scenario entails the simultaneous execution of several PySpark cells based on a condition.
Regards,
Janga