The below one is the data bricks workflow. Note: ETL_schema check is if/else task in databricks workflow)
Declaring below taskValues based on some conditions in ETL_data_check notebooks. Based on the below output the next task"ETL_schema_checks" (if/else) will be executed.
if failure:
dbutils.jobs.taskValues.set(key="flag_mismatch",value="failure")
else:
dbutils.jobs.taskValues.set(key="flag_mismatch",value="success")
using above if/else condtition etl_data_checks.
i am trying to deploy the workflow using databricks asset bundles. Below is the job definition. while deploying the code i am getting error "A managed resource tasks" "ETL_data_checks" has not been declared in the root module."
Could you please explain, what is the exact issue here, how to fix it?
Thanks in Advance!!