cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

[Databricks Assets Bundles] Workflow trigger on file arrival

Jorge3
New Contributor III

Hi everyone!
I'm setting up a workflow using Databricks Assets Bundles (DABs). And I want to configure my workflow to be trigger on file arrival. However all the examples I've found in the documentation use schedule triggers. 

Does anyone know if it is possible to use this type of trigger with DAB?

1 ACCEPTED SOLUTION

Accepted Solutions

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes you can use file_arrival triger with DAB.

Find below tag for your reference - 

resources:
  jobs:
    FileBasedJob:
      name: FileBasedJob
      trigger:
        pause_status: UNPAUSED
        file_arrival:
          url: abfss://test@uatazsubdatastorage.dfs.core.windows.net/
Ajay Kumar Pandey

View solution in original post

3 REPLIES 3

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes you can use file_arrival triger with DAB.

Find below tag for your reference - 

resources:
  jobs:
    FileBasedJob:
      name: FileBasedJob
      trigger:
        pause_status: UNPAUSED
        file_arrival:
          url: abfss://test@uatazsubdatastorage.dfs.core.windows.net/
Ajay Kumar Pandey

Jorge3
New Contributor III

@Ajay-Pandey thanks for the prompt reply, let my try it!
Then, I guess is also possible to use a continuous trigger, do you know the syntax for it?

Ajay-Pandey
Esteemed Contributor III

Hi @Jorge3 

Yes, you can use continues mode also.
Please find syntax below - 

resources:
  jobs:
    dbx_job:
      name: continuous_job_name
      continuous:
        pause_status: UNPAUSED
      queue:
        enabled: true
Ajay Kumar Pandey

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group