- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-06-2022 12:00 AM
Had entered below items thinking the contest was for future use cases..
posting them anyways - hoping it would be useful someday...
Here is a list of items we wish were available....
Workflow Failure Options:
Currently we have the option to set dependency based on job success.
Would be nice to have the option to trigger a job in case a job fails.
Conditional Workflow Options:
Similar to a scheduler - would be nice to have the option to trigger a job based on a variable or parameter across jobs. Say file name from job 1 passed to the job 2 or trigger different set of jobs based on the status code obtained in first job.
Custom E-Mail Options with Attachments:
Send a customized e-mail instead of the standard failure/success mail along with attachments.
Workflows - Filter and Sort from the UI:
Easier way to filter out currently running jobs, sort based on running time and not the last execution status.
Easier Way to bring data into Lake:
Easier way to bring data into the lake, like a ready made SFTP option that would directly import data into the datalake to be acted upon further by Databricks.