cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

[Databricks Assets Bundles] Workflow trigger on file arrival

Jorge3
New Contributor III

Hi everyone!
I'm setting up a workflow using Databricks Assets Bundles (DABs). And I want to configure my workflow to be trigger on file arrival. However all the examples I've found in the documentation use schedule triggers. 

Does anyone know if it is possible to use this type of trigger with DAB?

1 ACCEPTED SOLUTION

Accepted Solutions

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes you can use file_arrival triger with DAB.

Find below tag for your reference - 

resources:
  jobs:
    FileBasedJob:
      name: FileBasedJob
      trigger:
        pause_status: UNPAUSED
        file_arrival:
          url: abfss://test@uatazsubdatastorage.dfs.core.windows.net/

View solution in original post

3 REPLIES 3

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes you can use file_arrival triger with DAB.

Find below tag for your reference - 

resources:
  jobs:
    FileBasedJob:
      name: FileBasedJob
      trigger:
        pause_status: UNPAUSED
        file_arrival:
          url: abfss://test@uatazsubdatastorage.dfs.core.windows.net/

Jorge3
New Contributor III

@Ajay-Pandey thanks for the prompt reply, let my try it!
Then, I guess is also possible to use a continuous trigger, do you know the syntax for it?

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes, you can use continues mode also.
Please find syntax below - 

resources:
  jobs:
    dbx_job:
      name: continuous_job_name
      continuous:
        pause_status: UNPAUSED
      queue:
        enabled: true
Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.