cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Databricks Job Listener Concept for Tracking Personal Jobs

DatabricksQuery
New Contributor

Hello everyone

I want to know if any listener mechanism in Databricks can track the configuration of Databricks jobs deployed through CI/CD. With the help of this listener, we can track our custom jobs that are not part of the CI/CD process. This way, if any changes occur in the original job deployed through CI/CD, we can automatically update the parameters in the custom job configuration using some Python code

1 REPLY 1

saurabh18cs
Honored Contributor II

Hi , I don't think Databricks provides a built-in listener mechanism to track changes to job configurations directly. However, you can implement a custom solution to monitor and track changes to Databricks jobs deployed through CI/CD pipelines using databricks API's.

  • List Jobs: GET /api/2.1/jobs/list
  • Get Job Details: GET /api/2.1/jobs/get