Databricks Community

susanne

Hi all,I would like to publish the event_log of my DLT Pipeline to a specific schema in Unity Catalog.Following this article (https://docs.databricks.com/gcp/en/dlt/observability#query-the-event-log) this can be done by writing this into the DLTs set...

susanne · 01-24-2025

Hi everyone,I am building a dlt Pipeline and there I am using the Direct Publish feature which is as of now still under Private Preview.While it works well to create streaming tables and write them to another schema than the dlt default schema, I ge...

susanne · 12-05-2024

Hi all,I am implementing a DLT table with the new Direct Publish feature which is still in Private Preview.Is it a limitation of DLT with Direct Publish that you can not query the event_log of the DLT?When I use this query:SELECT * FROM event_log('pi...

susanne

If any one is interested how to access the event_log for DLTs that are writing to different schemas:The approach that was described above was not working anymore - at least for us.But we discovered this post:https://stackoverflow.com/questions/794329...

susanne · 02-05-2025

Hello everyone,I am having problems working with this approach andI am not sure if it is related to the recent changes in DLT Direct Publish (moving it to Public Preview) or if it is related to the changes I have made.I recently bound my existing DLT...

susanne · 01-30-2025

Hi Sidhan,thanks a lot for your reply, it works very well to write materialized views to a different schema than the default schema.Thanks for your guidance!Best regardsSusanne

susanne · 12-05-2024

@Walter_Cthank you so much, that worked perfectly 

susanne · 12-04-2024

For me the problem was solved when I defined the schema in dlt as following:@Dlt.table( name=f"{target_table}", schema = """userid STRING, contract_no INT, CONSTRAINT pk_<table_name> ...

Databricks Community

User Stats

User Activity

How to write event_log destination into DLT Settings JSON via Asset Bundles

Views in DLT with Private Preview feature Direct Publish

Possibilities and Limitations of Delta Live Tables (DLT) with Direct Publish mode

Re: Possibilities and Limitations of Delta Live Tables (DLT) with Direct Publish mode

Re: Possibilities and Limitations of Delta Live Tables (DLT) with Direct Publish mode

Re: Views in DLT with Private Preview feature Direct Publish

Re: Possibilities and Limitations of Delta Live Tables (DLT) with Direct Publish mode

Re: drop or alter primary key constraint for a streaming table in delta live tables