Databricks Community

varshini_reddy

varshini_reddy

Databricks UC enabled but Lineage not found for one table whereas i can see the lineage for the other two, any idea on why is it?. Im performing few transformations to bronze data , taking good_data_transformed as a dataframe, creating a temp view fo...

varshini_reddy

Hi Team, I have two questions, please clarigy.1. can we use multiple tasks inside a for each for databricks jobs2. is nested for each functionality available?

varshini_reddy

This is why the shared workaround, that will simply skip/fail all the next iterations without doing anything.?which one?, all above will only exit the NB right?

varshini_reddy

failing the NB is just failing that particular iteration, it isn't stopping the loop. I have to stop the for-each.

varshini_reddy

Got it, But here you are just stopping the NB execution right, but i want the for loop iteration to get stooped for that rootrunid. Let's say i have a for each loop in workflow inside which i have a job, for each iteration to be stooped/failed if o...

varshini_reddy

how does this work in databricks task or for loop? bcoz rootrunid is with respect to Databricks Notebooks right?

varshini_reddy

yes its 3does this stop the whole job run or just the NB? The whole context im talking about is in the workflow context where workflow should stop if the loop task had atleast 1 failure

Databricks Community

User Stats

User Activity

In databricks workflows, can we stop the loop run if one of the iteration fails?

Databricks UC enabled but Lineage not found for one table

Databricks Jobs For Each Functionality

Re: In databricks workflows, can we stop the loop run if one of the iteration fails?

Re: In databricks workflows, can we stop the loop run if one of the iteration fails?

Re: In databricks workflows, can we stop the loop run if one of the iteration fails?

Re: In databricks workflows, can we stop the loop run if one of the iteration fails?

Re: In databricks workflows, can we stop the loop run if one of the iteration fails?