Hubert-Dudek
Databricks MVP

You can create an Azure logic app that will call Azure Data Factory (there, you can choose from ready actions).

Azure logic app as a trigger can have web requests (REST API).

You can invoke it at the end of the notebook by calling a request. (requests.post(url))

You can also easily handle authentication by adding key headers and comparing in the logic app.


My blog: https://databrickster.medium.com/

View solution in original post