cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

When developing Delta Live Tables, is there a way to see the query history?

User16826992666
Valued Contributor

I am not sure where I can look currently to see how my DLT queries are performing. How can I investigate the query plan for past DLT runs?

1 REPLY 1

Priyanka_Biswas
Valued Contributor
Valued Contributor

Hello @Trevor Bishop​ 

You can check the query plan in the Spark UI , SQL tab. You would need to select the past run from dropdown and click on SparkUI

Additionally an event log is created and maintained for every Delta Live Tables pipeline. The event log contains all information related to the pipeline, including audit logs, data quality checks, pipeline progress, and data lineage. You can use the event log to track, understand, and monitor the state of your data pipelines.

Ref:https://docs.databricks.com/workflows/delta-live-tables/delta-live-tables-event-log.html

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.