cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

[Databricks Assets Bundles] Workflow trigger on file arrival

Jorge3
New Contributor III

Hi everyone!
I'm setting up a workflow using Databricks Assets Bundles (DABs). And I want to configure my workflow to be trigger on file arrival. However all the examples I've found in the documentation use schedule triggers. 

Does anyone know if it is possible to use this type of trigger with DAB?

1 ACCEPTED SOLUTION

Accepted Solutions

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes you can use file_arrival triger with DAB.

Find below tag for your reference - 

resources:
  jobs:
    FileBasedJob:
      name: FileBasedJob
      trigger:
        pause_status: UNPAUSED
        file_arrival:
          url: abfss://test@uatazsubdatastorage.dfs.core.windows.net/

View solution in original post

3 REPLIES 3

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes you can use file_arrival triger with DAB.

Find below tag for your reference - 

resources:
  jobs:
    FileBasedJob:
      name: FileBasedJob
      trigger:
        pause_status: UNPAUSED
        file_arrival:
          url: abfss://test@uatazsubdatastorage.dfs.core.windows.net/

Jorge3
New Contributor III

@Ajay-Pandey thanks for the prompt reply, let my try it!
Then, I guess is also possible to use a continuous trigger, do you know the syntax for it?

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes, you can use continues mode also.
Please find syntax below - 

resources:
  jobs:
    dbx_job:
      name: continuous_job_name
      continuous:
        pause_status: UNPAUSED
      queue:
        enabled: true
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!