Dlt pipeline showing legacy , even though all things are latest

[21f3001806]

Some of old dlt pipelines in my databricks workspace are showing legacy,

I am using serverless pipeline with mode - preview.

Anything which I missed ?

[RiyazAliM]

Hello @21f3001806 

Would you be able to share the JSON of your pipeline settings, having no info on your pipeline makes difficult to determine what's going on.

Please make sure to mask any PII info in the JSON before sharing.

Cheers!

[ashraf1395 · Accepted solution]

Hi @21f3001806 , I recently got a similar error for my old pipelines. so databricks recently made dlt direct publising mode ga which caused some changes in the dlt pipeline configuration definition so if you use the setting 'target' in your pipeline it will show legacy , if you change it to 'schema' it will be corrected. Basically it means that dlt supporting unity catalog.

here's the link : https://www.databricks.com/blog/publish-multiple-catalogs-and-schemas-single-dlt-pipeline

Not sure whether this is the right solution but you can give it a try

[RiyazAliM]

Hi @ashraf1395 - I'm trying to reproduce the `legacy` pipeline with no luck, I'm trying to understand - so basically, I should select the destination as Hive metastore instead of UC? 

Thanks for the helpful link with updates.

[ashraf1395]

Hi @RiyazAliM , I am not sure whether that works or not. 
In my case :
the dlt pipeline configuration : instead of use target as a parameter instead of schema
Like in this below image it show legacy 

[RiyazAliM]

@ashraf1395 - I understand now, let me try it once.