- 2905 Views
- 3 replies
- 0 kudos
How to trigger workflow job tasks from Autoloader
I have configured a File Notification Autoloader that monitors S3 bucket for binary files. I want to integrate autoloader with workflow job so that whenever a file is placed in S3 bucket, the pipeline job notebook tasks can pick-up new file and start...
- 2905 Views
- 3 replies
- 0 kudos
- 0 kudos
Hi @Saravanan Ponnaiah​ Hope everything is going great.Does @odoll odoll​ response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly?We'd love to hear from you.Thanks!
- 0 kudos
- 2519 Views
- 3 replies
- 10 kudos
Resolved! How to retrieve Auto Loader client secret from Azure Key Vault?
I'm using Auto Loader in a SQL notebook and I would like to configure file notification mode, but I don't know how to retrieve the client secret of the service principal from Azure Key Vault. Is there any example notebook somewhere? The notebook is p...
- 2519 Views
- 3 replies
- 10 kudos
- 10 kudos
Hi @Magnus Johannesson​ , you must use the Secrets utility (dbutils.secrets) in a notebook or job to read a secret.https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-utils#dbutils-secretsHope it helps!
- 10 kudos