cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Error deploying DLT DAB: Validation failed for cluster_type, the value must be dlt (is "job")

ahab
New Contributor

Hello.

I'm getting a cluster validation error while trying to deploy a DLT pipeline via DAB.

See attached screenshots for config and error.

Hoping someone has run into this before and can guide me.

Thanks.

1 REPLY 1

MohcineRouessi
New Contributor II

Hey @ahab,

Were you able to solve this issue, if yes would you mind sharing your finds 🙏

If not, looking at your cluster policy, I'm seeing that you are using dlt as the cluster type which is the correct needed type for DLT pipelines, but in the resources mapping (job_yml file), you are only defining a workflow job with the keyword jobs and its specific mappings, while in order to create a DLT pipeline you need to use the pipelines keyword that has its own dedicated settings, an example of a DLT pipeline definition here and the full list of parameters for the mappings can be found here

@Retired_mod could you please advise here

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now