How can we Implement Conditional Logic on SQL Query Output in Job Workflow

vishesh_berera — Wed, 13 Aug 2025 19:23:24 GMT

I'm trying to create a job where I define a get data task that executes a SQL query. After that, I want to apply conditional logic using an if-else task based on the query output. Specifically, I want to check each row individually—if a condition is met, perform one task; otherwise, perform a different task.

However, in the if-else task, I'm only able to access the first row of the SQL output using {{tasks.get_data.output.first_row.column_name}}. I want to iterate over all rows, similar to how it's done in Azure Data Factory using {{tasks.get_data.output.values}}. How can I achieve this?

#Datengineering

Re: How can we Implement Conditional Logic on SQL Query Output in Job Workflow

BR_DatabricksAI — Thu, 14 Aug 2025 08:10:19 GMT

Hello, I believe the the fixed parameter option is exists and introduced recently in lake flow declarative pipeline where you need to navigate to the configuration section and add parameters.

topic How can we Implement Conditional Logic on SQL Query Output in Job Workflow in Data Engineering

How can we Implement Conditional Logic on SQL Query Output in Job Workflow

Re: How can we Implement Conditional Logic on SQL Query Output in Job Workflow