โ04-23-2024 01:59 AM
Hi everyone!
I'm setting up a workflow using Databricks Assets Bundles (DABs). And I want to configure my workflow to be trigger on file arrival. However all the examples I've found in the documentation use schedule triggers.
Does anyone know if it is possible to use this type of trigger with DAB?
โ04-23-2024 02:28 AM
Hi @Jorge3
Yes you can use file_arrival triger with DAB.
Find below tag for your reference -
resources:
jobs:
FileBasedJob:
name: FileBasedJob
trigger:
pause_status: UNPAUSED
file_arrival:
url: abfss://test@uatazsubdatastorage.dfs.core.windows.net/
โ04-23-2024 02:28 AM
Hi @Jorge3
Yes you can use file_arrival triger with DAB.
Find below tag for your reference -
resources:
jobs:
FileBasedJob:
name: FileBasedJob
trigger:
pause_status: UNPAUSED
file_arrival:
url: abfss://test@uatazsubdatastorage.dfs.core.windows.net/
โ04-23-2024 02:42 AM
@Ajay-Pandey thanks for the prompt reply, let my try it!
Then, I guess is also possible to use a continuous trigger, do you know the syntax for it?
โ04-23-2024 05:20 AM
Hi @Jorge3
Yes, you can use continues mode also.
Please find syntax below -
resources:
jobs:
dbx_job:
name: continuous_job_name
continuous:
pause_status: UNPAUSED
queue:
enabled: true
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group