Unable to configure custom compute for DLT pipeline

[GANAPATI_HEGDE]

I am trying to configure cluster for a pipeline like above, However dlt keeps using the small cluster as usual, how to resolve this?

[szymon_dybczak]

Hi @GANAPATI_HEGDE ,

Your YAML definition looks correct. I've used following definition and it worked as expected. Which version of databricks cli are you using? In my case with CLI v0.272.0 I didn't encounter any issues.

[GANAPATI_HEGDE]

i updated my CLI and deployed the job, still i dont see the clusters updates in  pipeline