Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
we are starting to experiment with Databricks Asset Bundles, especially to keep jobs aligned between workspaces. Is there a way to start managing existing jobs, to avoid erasing previous runs history?
Hi @tomph Currently there is no way to start managing existing jobs, to avoid erasing previous runs history with Databricks Asset Bundles but soon we will support it as we’re working on functionality that will allow to bind bundle configuration to the existing resource, you can follow this PR:- https://github.com/databricks/cli/pull/1131
Changes Added bundle deployment bind and unbind command. This command allows to bind bundle-defined resources to existing resources in Databricks workspace so they become DABs-managed. Tests Manual...
Hi @tomph Currently there is no way to start managing existing jobs, to avoid erasing previous runs history with Databricks Asset Bundles but soon we will support it as we’re working on functionality that will allow to bind bundle configuration to the existing resource, you can follow this PR:- https://github.com/databricks/cli/pull/1131
Changes Added bundle deployment bind and unbind command. This command allows to bind bundle-defined resources to existing resources in Databricks workspace so they become DABs-managed. Tests Manual...
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.