Databricks Community

Hello, I'm wondering how can I schedule multiple jobs (workflow).I'd like to do something like this but on a workflow level.  tasks: - task_key: task_1 sql_task: warehouse_id: ${var.warehouse_id} paramet...

Regarding DAGs and tasks in them - can I pass a parameter/variable in a task?I have the same structure like here: https://github.com/databricks/bundle-examples/blob/main/default_sql/resources/default_sql_sql_job.ymland I want to pass variables to .sq...

Hello everyone,I couldn't find a topic on this - what are your best practices to ensuring data quality in batch pipelines?I've got a big pipeline processing data once per day. We though about either going with DBT or DLT but DLT seems more directed f...