Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
I'm working on a project that combines dbt core with MetricFlow for metric management. I've set up my pipeline within a Databricks workflow, using the "dbt" workflow task type. While standard dbt commands (like dbt debug or dbt build) execute without issues, I'm facing challenges when trying to incorporate MetricFlow commands.
Specifically, when I attempt to add a task to my workflow that includes a MetricFlow command (e.g., mf query --metrics metric_name), I encounter an error indicating that only commands starting with "dbt" or "edr" are allowed