Error deploying DLT DAB: Validation failed for cluster_type, the value must be dlt (is "job")

ahab — Tue, 05 Mar 2024 21:44:09 GMT

Hello.

I'm getting a cluster validation error while trying to deploy a DLT pipeline via DAB.

See attached screenshots for config and error.

Hoping someone has run into this before and can guide me.

Thanks.

Re: Error deploying DLT DAB: Validation failed for cluster_type, the value must be dlt (is "job

MohcineRouessi — Wed, 28 Aug 2024 11:28:51 GMT

Hey @ahab,

Were you able to solve this issue, if yes would you mind sharing your finds 🙏

If not, looking at your cluster policy, I'm seeing that you are using dlt as the cluster type which is the correct needed type for DLT pipelines, but in the resources mapping (job_yml file), you are only defining a workflow job with the keyword jobs and its specific mappings, while in order to create a DLT pipeline you need to use the pipelines keyword that has its own dedicated settings, an example of a DLT pipeline definition here and the full list of parameters for the mappings can be found here

@Retired_mod could you please advise here

topic Error deploying DLT DAB: Validation failed for cluster_type, the value must be dlt (is "job") in Data Engineering

Error deploying DLT DAB: Validation failed for cluster_type, the value must be dlt (is "job")

Re: Error deploying DLT DAB: Validation failed for cluster_type, the value must be dlt (is "job