Execute Pyspark cells concurrently
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-29-2024 09:36 AM
Hi Team,
Hi Team,
Is it feasible to run pyspark cells concurrently in databricks notebooks? If so, kindly provide instructions on how to accomplish this. We aim to execute the intermediate steps simultaneously.
The given scenario entails the simultaneous execution of several PySpark cells based on a condition.
Regards,
Janga