Databricks Community

azam-io

I have a scenario where my Databricks asset bundles require two types of job parameters:Common parameters that apply to all environmentsEnvironment-specific parameters that differ per environment.My current YAML setup is structured like this:# common...

azam-io

Hi all, I am working with databricks asset bundle and want to separate environment-specific job params (for example, for "env" and "dev") for each pipeline within my bundle. I need each pipeline to have its own job params values for different environ...

azam-io · 03-16-2025

Hi, I am currently using DABs in my project and have encountered an issue. Specifically, I need to pass different job parameters or environment variables depending on the target and for specific jobs.Could you please provide guidance on how to approa...

azam-io

Hi Fede, thanks for your response. What I’m aiming for is to keep the variables separated by job and, within each job, by environment. For example, I envision a folder structure under the resources directory where each job has its own folder, and ins...

azam-io · 03-17-2025

Hi @Nivethan_Venkat, thanks for your response, it's quite helpful. However i would like to know if there is any way to define those variables inside the resource file of the job instead of defining them in separate folders. You know like we do inside...

Databricks Community

User Stats

User Activity

How do I efficiently manage common and environment-specific job parameters in DABs

How can I structure pipeline-specific job params separately in Databricks Asset Bundle.

Passing Different Job Parameters or Environment Variables Based on Targets in DABs

Re: How can I structure pipeline-specific job params separately in Databricks Asset Bundle.

Re: Passing Different Job Parameters or Environment Variables Based on Targets in DABs