Databricks Job Listener Concept for Tracking Personal Jobs

DatabricksQuery
New Contributor

Hello everyone

I want to know if any listener mechanism in Databricks can track the configuration of Databricks jobs deployed through CI/CD. With the help of this listener, we can track our custom jobs that are not part of the CI/CD process. This way, if any changes occur in the original job deployed through CI/CD, we can automatically update the parameters in the custom job configuration using some Python code

saurabh18cs
Honored Contributor II

Hi , I don't think Databricks provides a built-in listener mechanism to track changes to job configurations directly. However, you can implement a custom solution to monitor and track changes to Databricks jobs deployed through CI/CD pipelines using databricks API's.

  • List Jobs: GET /api/2.1/jobs/list
  • Get Job Details: GET /api/2.1/jobs/get