How can we Implement Conditional Logic on SQL Query Output in Job Workflow
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-13-2025 12:23 PM
I'm trying to create a job where I define a get data task that executes a SQL query. After that, I want to apply conditional logic using an if-else task based on the query output. Specifically, I want to check each row individually—if a condition is met, perform one task; otherwise, perform a different task.
However, in the if-else task, I'm only able to access the first row of the SQL output using {{tasks.get_data.output.first_row.column_name}}. I want to iterate over all rows, similar to how it's done in Azure Data Factory using {{tasks.get_data.output.values}}. How can I achieve this?
#Datengineering
- Labels:
-
Workflows
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-14-2025 01:10 AM
Hello, I believe the the fixed parameter option is exists and introduced recently in lake flow declarative pipeline where you need to navigate to the configuration section and add parameters.