topic Databricks Job Listener Concept for Tracking Personal Jobs in Data Engineering

Databricks Job Listener Concept for Tracking Personal Jobs

DatabricksQuery — Wed, 09 Apr 2025 08:03:45 GMT

Hello everyone

I want to know if any listener mechanism in Databricks can track the configuration of Databricks jobs deployed through CI/CD. With the help of this listener, we can track our custom jobs that are not part of the CI/CD process. This way, if any changes occur in the original job deployed through CI/CD, we can automatically update the parameters in the custom job configuration using some Python code

Re: Databricks Job Listener Concept for Tracking Personal Jobs

saurabh18cs — Wed, 09 Apr 2025 08:39:24 GMT

Hi , I don't think Databricks provides a built-in listener mechanism to track changes to job configurations directly. However, you can implement a custom solution to monitor and track changes to Databricks jobs deployed through CI/CD pipelines using databricks API's.

List Jobs: GET /api/2.1/jobs/list
Get Job Details: GET /api/2.1/jobs/get