Yaadhudbe
New Contributor II

You can use the databricks API to collect all required information.. 

https://docs.databricks.com/api/workspace/jobs/list