What are the Delta Live Tables limitations with relation to Unity Catalog?

eimis_pacheco — Fri, 29 Sep 2023 00:14:00 GMT

Hi community!

I was in a Databricks webinar and one of the participants said "Delta Live Tables seems to have some limitations when using with Unity Catalog. Is the idea to get parity with Hive?" and someone answered "DLT + Unity Catalog combination has two major limitations as of now : Not able to follow medallion architecture & no support for 3rd party library"

To what does he refer when he said "DLT not being able to follow medallion architecture & no support for 3rd party libraries?

Why does DLT struggle with Unity Catalog?

What are other limitations we should take into consideration before creating a workflow with DLT?

Thank you very much for your advice and insights

Regards

Re: What are the Delta Live Tables limitations with relation to Unity Catalog?

eimis_pacheco — Tue, 17 Oct 2023 20:25:07 GMT

Hi @Retired_mod ,

Thank you for your answer. Wondering then why Databricks recommends the usage of both solutions (DLT and Unity Catalog) even with the existence of this imcompatibilities?

Best Regards

topic Re: What are the Delta Live Tables limitations with relation to Unity Catalog? in Data Engineering

What are the Delta Live Tables limitations with relation to Unity Catalog?

Re: What are the Delta Live Tables limitations with relation to Unity Catalog?