- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-27-2024 02:52 PM - edited 06-27-2024 02:58 PM
Hi Kaniz,
Thank you for replying back to my request. Yes I am consolidating all table record counts using notebook task (Task A) and passing 'Total_rec_counts' to condition_task (Task B) . It validate the 'Total_rec_counts' and decide to run DLT pipeline.
code
dynamic "task" {
for_each = var.map_of_tables
content {
task_key = "${var.env}_validate_total_rec_count_${lower(task.key)}"
run_if = "ALL_SUCCESS"
depends_on{
Task_keY="${var.env}_get_total_rec_count_${lower(task.key)}" # Task to get the record counts
}
condition_task {
left = "{{tasks.${var.env}_get_total_rec_count_${lower(task.key)}.values.total_rec_count}}"
op = "GREATER_THAN"
right = 0
}
}
}
Error :- it is not able to identify left operand
Error: cannot update job: The "left" operand of the if/else condition alid reference. Invalid reference: '{{tasks.env-HLQ_UNIT_TEST_get_total_rec_count.values.total_rec_count}}'. '{{tasks.env-HLQ_UNIT_TEST_get_total_rec_count.values.total_rec_count}}' is unknown.
please suggest how to fix it . My dependency syntax is little different than yours. The syntax you proposed was giving error.