Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-28-2022 09:26 PM
Hi @andrew li
Yes, They do run on the cluster on which the master notebook is running.
Specifically, we are multithreading the Spark driver with Futures to enable parallel job submission.
You can check out more on threads and futures for deeper understanding.
Hope this helps. Do mark the above as the best answer if it helped.
Cheers.
Uma Mahesh D