ranged_coop
Valued Contributor II

Had entered below items thinking the contest was for future use cases..

posting them anyways - hoping it would be useful someday...

Here is a list of items we wish were available....

Workflow Failure Options:

Currently we have the option to set dependency based on job success.

Would be nice to have the option to trigger a job in case a job fails.

Conditional Workflow Options:

Similar to a scheduler - would be nice to have the option to trigger a job based on a variable or parameter across jobs. Say file name from job 1 passed to the job 2 or trigger different set of jobs based on the status code obtained in first job.

Custom E-Mail Options with Attachments:

Send a customized e-mail instead of the standard failure/success mail along with attachments.

Workflows - Filter and Sort from the UI:

Easier way to filter out currently running jobs, sort based on running time and not the last execution status.

Easier Way to bring data into Lake:

Easier way to bring data into the lake, like a ready made SFTP option that would directly import data into the datalake to be acted upon further by Databricks.