Can we create event based triggers/schedules in Databricks itself without using ADF

SailajaB
Databricks Partner
 

-werners-
Esteemed Contributor III

At the moment not with the web ui.

You could trigger a job run via the API.

But you still have to write a script (python, bash, ...) which does the evaluation of the event and calls the api.

I think in time Databricks will add this functionality, it's only logical.

Hubert-Dudek
Databricks MVP

One solution is also to write custom connector in logic apps. Once you will create API calls in postman to run a job in databricks you can upload postman library to logic apps so then it will be triggered by event of your choice.


My blog: https://databrickster.medium.com/

Atanu
Databricks Employee
Databricks Employee