DAB - Add/remove task depending on workspace.

[p4pratikjain]

I use DAB for deploying Jobs, I want to add a specific Task in dev only but not in staging or prod. Is there any way to achieve this using DAB ?

[mark_ott]

Yes, you can add a task in Databricks Asset Bundles (DAB) that exists only in the development environment and not in staging or production. This is handled by defining environment-specific resources using the "targets" mapping in your bundle configuration. For example, in your bundle.yml or equivalent configuration file, you specify tasks or jobs under each target (such as dev, staging, prod). Only tasks or jobs defined within the dev target will be deployed to that environment, and will not appear in other targets like staging or prod.​

To do this:

• Define your dev-only task under the resources section inside the dev target in your bundle configuration.

• Do not include that task under the staging or prod targets.

This modular structure makes it easy to have environment-specific jobs or tasks, such as dev-only test or experiment tasks, without affecting staging or production deployments.​

[Coffee77]

You can define specific resources by target in DAB as shown here. This is valid for jobs and/or tasks:

For instance, in my case:

I think, best option (but not available as far as I know) would be to be able to define "include" sections by target, instead of having to put all resources code @mark_ott