topic How do I deploy or run one job if I have multiple jobs in a Databricks Asset Bundle? in Data Engineering

How do I deploy or run one job if I have multiple jobs in a Databricks Asset Bundle?

cs_de — Thu, 17 Apr 2025 13:50:14 GMT

How do I deploy or run a single job if I have 2 or more jobs defined in my asset bundle?

$databricks bundle deploy job1 #does not work

I do not see a flag to identify what job to run.

Re: How do I deploy or run one job if I have multiple jobs in a Databricks Asset Bundle?

madams — Thu, 17 Apr 2025 18:17:18 GMT

What are you trying to solve? I believe an asset bundle is intended to be deployed as a whole unit (hence why it's a bundle). Why would you want to deploy one job from it, and not the others? If there are no changes to an existing job, nothing will be applied.

As far as running just one, `databricks bundle run job1` should work. https://docs.databricks.com/aws/en/dev-tools/cli/bundle-commands#run-a-job-or-pipeline

Re: How do I deploy or run one job if I have multiple jobs in a Databricks Asset Bundle?

mark_ott — Thu, 17 Apr 2025 22:16:15 GMT

I haven't done it with multiple jobs, but I think under resources you name multiple jobs, then when you deploy you just call that job key.

Re: How do I deploy or run one job if I have multiple jobs in a Databricks Asset Bundle?

cs_de — Thu, 17 Apr 2025 22:22:09 GMT

`databricks bundle run job1` works, but `databricks bundle deploy job1` does not.

To your point I guess the deploy does not really matter if nothing has changed so maybe I am overthinking it.

Re: How do I deploy or run one job if I have multiple jobs in a Databricks Asset Bundle?

Louis_Frolio — Thu, 17 Apr 2025 23:12:19 GMT

Outstanding @mark_ott !