Hi @ctiwari7 ,

I don't know if this is a better approach, because it's a very subjective matter, but you can try to use 2 alternative approaches:

1. system tables - >  Jobs system table reference | Databricks on AWS 

2.  REST API calls to first:

     - get a list of all job names and their respective ids using list jobs REST API endpoint

     List jobs | Jobs API | REST API reference | Azure Databricks

    - use the job runs endpoint to get active job runs with all required information. Then you can associate job_run           with job_name using job_id atribute
     List job runs | Jobs API | REST API reference | Azure Databricks