Yaadhudbe
New Contributor II

You can use the databricks API to collect all required information.. 

https://docs.databricks.com/api/workspace/jobs/list

Load the output to a delta table. 

Use the Databricks dashboards in displaying this data.. schedule the job for loading the databricks job details as required..