cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Getting status of "If Condition" Activity into a variable

sreedata
New Contributor III

"If Condition" has lot of activities that can succeeded or fail. If any activity fails then whole "If Condition" fails. I have to get the status of the "If Condition" activity (pass or fail) so that i can use it for processing in the next notebook that follows it.

Please suggest some ways

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

UmaMahesh1
Honored Contributor III

In your ADF Pipeline activity, set two different pipeline activities from the If condition activity based on success or failure (the green and red arrows).

Then inside each pipeline activity, you can add a set variable, get variable and your adb notebook activities. In set variable, you would be setting the status of your activity using the standard pipeline parameters.

Hope this helps...Cheers..

Uma Mahesh D

View solution in original post

4 REPLIES 4

Hubert-Dudek
Esteemed Contributor III

Can you share your code? I don't know if python, SQL, or some logic in orchestration tool.

In python, you would need to set try catch in every if statement and use dbutils.notebook.exit('message') to handle it in another notebook.

dbutils.notebook.exit('message') .This is also a good way .But since my if activity has multiple notebooks it would get complicated.So setting base parameters from success and fail path helped

UmaMahesh1
Honored Contributor III

In your ADF Pipeline activity, set two different pipeline activities from the If condition activity based on success or failure (the green and red arrows).

Then inside each pipeline activity, you can add a set variable, get variable and your adb notebook activities. In set variable, you would be setting the status of your activity using the standard pipeline parameters.

Hope this helps...Cheers..

Uma Mahesh D

sreedata
New Contributor III

Thanks .This helped.Set a base parameter to the notebook with status sucess or fail

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group