Hi all,

In my Asset Bundle I have some setting for a cluster like in the example at Substitutions and variables in Databricks Asset Bundles (section Define a complex variable).

Now I want to add some additional attribute when using this variables, like this:

resources:
  jobs:
    my_job:
      job_clusters:
        - job_cluster_key: my_cluster_key
          new_cluster: 
            <<: ${var.my_cluster}
            custom_tags:
              foo: bar
      tasks:
        - task_key: hello_task
          job_cluster_key: my_cluster_key

Unfortunately this results in the error "map merge requires map or sequence of maps as the value".

I assume that the YAML map operator is applied first (so while the value is still a string - and thus resulting in the error) and only afterwards the variable would be replaced.

Have you come around a similar problem? If yes, how did you solve it?

Thanks and regards!