cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Rearrange tasks in databricks workflow

chemajar
New Contributor III

Hello,

There is anyway to rearrange tasks in databricks workflow?.

I would like that line that join the two marked tasks doesn't pass behind the other tasks.  It is posible that this line by one side?

Thanks.

image.png

 

2 ACCEPTED SOLUTIONS

Accepted Solutions

Kaniz_Fatma
Community Manager
Community Manager

Hi @chemajar In Databricks Workflows, you can arrange tasks and control their execution order.

Let’s explore how you can achieve this:

  1. Task Dependencies:

  2. Task Ordering:

    • If you want to ensure that the line connecting two marked tasks doesn’t pass behind other tasks, consider the following approaches:
      • Swap Tasks:
      • Manual Ordering:
        • Arrange the tasks in the desired order within your workflow.
        • Ensure that the dependent tasks are placed before the tasks they rely on.
  3. Visual Clarity:

    • While Databricks doesn’t provide a direct way to move the connecting line to one side, you can enhance visual clarity by organizing tasks logically.
    • Consider grouping related tasks together and placing them in a sequence that makes sense for your workflow.

Remember that Databricks Jobs determines whether a job run was successful based on the outcome of leaf tasks (tasks with no downstream dependencies). So, ensure that your task dependencies are correctly defined to achieve the desired execution order1.

Feel free to explore these options and adapt them to your specific workflow needs! 🚀

 

View solution in original post

chemajar
New Contributor III

Thank you very much, the Visual Clarity part was what I thoght

View solution in original post

3 REPLIES 3

Kaniz_Fatma
Community Manager
Community Manager

Hi @chemajar In Databricks Workflows, you can arrange tasks and control their execution order.

Let’s explore how you can achieve this:

  1. Task Dependencies:

  2. Task Ordering:

    • If you want to ensure that the line connecting two marked tasks doesn’t pass behind other tasks, consider the following approaches:
      • Swap Tasks:
      • Manual Ordering:
        • Arrange the tasks in the desired order within your workflow.
        • Ensure that the dependent tasks are placed before the tasks they rely on.
  3. Visual Clarity:

    • While Databricks doesn’t provide a direct way to move the connecting line to one side, you can enhance visual clarity by organizing tasks logically.
    • Consider grouping related tasks together and placing them in a sequence that makes sense for your workflow.

Remember that Databricks Jobs determines whether a job run was successful based on the outcome of leaf tasks (tasks with no downstream dependencies). So, ensure that your task dependencies are correctly defined to achieve the desired execution order1.

Feel free to explore these options and adapt them to your specific workflow needs! 🚀

 

chemajar
New Contributor III

Thank you very much, the Visual Clarity part was what I thoght

artsheiko
Valued Contributor III
Valued Contributor III

Hi @chemajar,

Take a look at Databricks Asset Bundles. It allows you to streamline the development of complex workflows using a yaml definition. In case you need to change the task dependencies, you can rearrange the flow as you need just change the yaml definition.

If you need a yaml definition for an existing workflow, you can find it by clicking on a three-points menu at the top right corner of the chosen workflow.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!