- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-08-2022 05:05 PM
I have created a job, Inside a job I have created tasks which are independent, I have used the concept of concurrent futures to exhibit parallelism and in each task there are couple of notebooks running(which are independent) Each notebook running has a job-id (notebook #[job-id)] Is there a way that I can retrieve the job-id for those notebooks. Please let me know. Thanks!
- Labels:
-
Databricks api
-
Job
-
Notebook
-
Parallel notebooks
-
Tasks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-11-2022 12:28 AM
Swetha, why not use Workflows? There's a powerful API for getting all the metadata you need. An no need to write code to manage parallelism yourself.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-12-2022 11:29 PM
I appreciate the information and advice you have shared. I will try to figure it out for more.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-23-2022 11:20 PM
Hi @swetha kadiyala
Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.
We'd love to hear from you.
Thanks!
