cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How can I get logging or print output from a Delta Live Table workflow.

aliacovella
Contributor

I'm trying to debug a task that is a DLT workflow and I've tried putting in log statements and print statements but I can't seem to see the output in the event log after the run nor can I see the print statements anywhere. Can someone point me to where I can view these or how to properly log output from within a workflow run?

3 REPLIES 3

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @aliacovella,

What is the failure you are observing during the DLT runtime? have you used event logs?

Other option is to run the code directly on a notebook.

aliacovella
Contributor

I'm not actually getting a failure, but I want to see that the value of a parameter I set up in the workflow is being set correctly where it is used. In this case I'd like to parameterize the Kinesis stream I'll be polling from, so I'd like to pass that as a job run parameter and have it used within the pipeline.  I'd like to be able to view that or have logging in general so I can view variables etc. Logging to info or even error does not seem to come out anywhere and print statements don't seem to display anywhere either, so I'm kind of confused as to how I can put in some kind of logging that I can view somewhere. 

Edthehead
Contributor II

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group