cancel
Showing results for 
Search instead for 
Did you mean: 
Warehousing & Analytics
cancel
Showing results for 
Search instead for 
Did you mean: 

Show full logs on job log

Kaz
New Contributor II

Is it possible to show the full logs of a databricks job? Currently, the logs are skipped with:

*** WARNING: max output size exceeded, skipping output. ***

However, I don't believe our log files are more than 20 MB. I know you can press the logs button and view the full logs there. However, due to admin rights we would like to be able to read all logs in the job overview, without having access to the logs (and therefore other) button(s). 

 

 

1 REPLY 1

Kaniz
Community Manager
Community Manager

Hi @Kaz , it's not possible to display the complete logs of a Databricks job in the job overview if the log output size has been exceeded. Databricks have a limit on the size of the output logs that can be displayed in the job overview. If the output logs exceed this limit, the system will display a warning message "max output size exceeded, skipping output."The only way to view the complete logs is by clicking on the logs button. This is a limitation of the Databricks platform and cannot be overridden by any settings or configurations.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.