Hii all,
I’m working with Databricks Asset Bundles (DAB) and trying to move from a single repository-level bundle to a structure where each workflow (folder under resources/jobs) has its own bundle.
• My repository contains:
• Shared src/variables.yml and src/env/*.yml for common variables and permissions
• Multiple job definitions in resources/jobs/<workflow_name>/*.yml
• A separate databricks.yml inside each workflow folder so that each workflow can be deployed independently as its own bundle.
What happens:
• When I keep a single databricks.yml at the repo root and include all jobs in one bundle → deployment works fine.
• When I move to one bundle per workflow (placing databricks.yml inside each job folder) →
• databricks bundle validate passes or gives only warnings
• but databricks bundle deploy fails with:
Error: exit status 1
Error: failed to read provider configuration schema for registry.terraform.io/databricks/databricks:
failed to instantiate provider "registry.terraform.io/databricks/databricks" to obtain schema:
Unrecognized remote plugin message:
This usually means that the plugin is either invalid or simply needs to be recompiled to support the latest protocol.
This happens even when the two bundles are nearly identical (just adapted per workflow/job). One workflow deploys successfully, another fails with this error.
Has anyone seen this Databricks provider schema error only when splitting bundles by workflow?
Thank you
