How to set a job trigger in a yml deployment asset bundle?

[DatabricksDude]

Working on an asset bundle/yml file to deploy a job and some notebooks.  How to specify within the yml file a trigger to run the job when files arrive at a specified location?  Thanks in advance!

[Kaniz]

Hi @DatabricksDude, To trigger a job in your YAML file when specific files arrive at a specified location, you can use the following approaches based on the context of your deployment:

1. GitLab CI/CD:

   • If you’re using GitLab CI/CD, you can achieve this by defining rules for your job. The changes keyword allows you to specify patterns for files that trigger the job. However, by default, it only triggers for the current commit.
   • To make the job run whenever a file in the specified directory changes at any commit in the branch, consider using merge requests (MRs). Create a unique MR job that contains the relevant changes part. For example:

     build-mr:
       extends: .build_job
       before_script:
         - APP=one
       only:
         refs:
           - merge_requests
       changes:
         - src/one/**/*
     

     This way, the job will run after merging the side branch into the target branch¹.

2. Azure DevOps:

   • In Azure DevOps YAML pipelines, you can set CI triggers using a simple syntax. For instance, to trigger a build when pushing to the develop branch, include the following in your Y...

     trigger:
       branches:
         include:
           - develop
     

     Adjust the branch names as needed².

3. Databricks:

   • If you’re working with Databricks, you can use the Databricks CLI or REST API to trigger a job. Here’s an example using Databricks CLI in a YAML pipeline:

     # Your YAML pipeline configuration
     # ...
     trigger_job:
       trigger:
         include:
           - local: path/to/job-to-run-when-file-changes.yml
     

     Replace path/to/job-to-run-when-file-changes.yml with the actual path to your Databricks job configu...³.

Happy deploying! 🚀