topic Re: How can I use multiple schema in DLT? in Data Engineering

How can I use multiple schema in DLT?

Hariharan49 — Tue, 11 Jun 2024 22:26:30 GMT

Hi I would like to use multiple schema as destination in dlt but currently I can just give single unity schema . I have my tables of multi hop in different schema.

Re: How can I use multiple schema in DLT?

mhiltner — Wed, 12 Jun 2024 00:32:18 GMT

Unfortunately this is not possible at the moment. DLTs only target a single schema as destination.

Companies with such architecture are running several DLTs, one for each schema.

I believe this is expected for the future, but this is a limitation atm.

Re: How can I use multiple schema in DLT?

kuldeep-in — Sat, 01 Feb 2025 12:04:28 GMT

@Hariharan49 'Direct Publishing Mode' Public Preview is now live on all production regions. This feature will allow you to write to multiple schemas & catalogs from the same pipeline.

Re: How can I use multiple schema in DLT?

michelleliu — Fri, 14 Feb 2025 05:38:21 GMT

Thanks for the info! I just tried and it worked! Although I don't know what 'direct publishing mode' is. I don't see that in my environment. But I just specified a different schema in the codes and it worked!

Re: How can I use multiple schema in DLT?

kuldeep-in — Fri, 14 Feb 2025 08:56:08 GMT

Hello @micmic

AS DPM is in Public preview so all new DLT pipelines created from the UI will have Direct Publishing Mode (DPM) enabled by default. This will not require any additional configuration.