topic Re: Asset bundle yml factorization in Administration & Architecture

Asset bundle yml factorization

erigaud — Fri, 19 Jul 2024 05:38:45 GMT

Hello,

I have a project using asset bundle in which I have several jobs using roughly the same job definition (tags and job clusters definitions are always the same)

Is there a way to put everything in common in a yml file and reuse that in each individual yml file of each job ?

Thank you !

Re: Asset bundle yml factorization

erigaud — Thu, 25 Jul 2024 06:38:31 GMT

Hello @Retired_mod
I want to use complex variables but I would like to define all my variables in a separate file, I do not want to have them declared in the databricks.yml.

Is there a way to do that ? Thank you

Re: Asset bundle yml factorization

Witold — Thu, 25 Jul 2024 07:43:15 GMT

@erigaud

What might work, I actually never tried it by myself so far, is this:

Define your complex variables in a separate yaml file (complex variables are supported since v0.222.0), import this file using include, and reference these variables accordingly.