How to trigger workflow job tasks from Autoloader
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-30-2022 03:28 AM
I have configured a File Notification Autoloader that monitors S3 bucket for binary files. I want to integrate autoloader with workflow job so that whenever a file is placed in S3 bucket, the pipeline job notebook tasks can pick-up new file and start processing. How can we integrate autoloader with a workflow job to trigger task execution when a file is detected in S3 bucket? Any pointers will be much appreciable. I referred several links but all of them talks up to setting up autoloader, and not about triggering further tasks.
Labels: