- 10177 Views
- 7 replies
- 3 kudos
Resolved! Download event, driver, and executor logs
Hi Team, I can see logs in Databricks console by navigating workflow -> job name -> logs. These logs are very generic like stdout, stderr and log4-avtive.log. How to download event, driver, and executor logs at once for a job? Regards,Rajesh.
- 10177 Views
- 7 replies
- 3 kudos
- 3 kudos
@Kaniz Fatma​ @John Lourdu​ @Vidula Khanna​ Hi Team,I managed to download logs using the Databricks command line as below: Installed the Databricks command line on my Desktop (pip install databricks-cli)Configured the Databricks cluster URL and perso...
- 3 kudos
- 1559 Views
- 1 replies
- 2 kudos
Best sequence of using Vacuum, optimize, fsck repair and refresh commands.
I have a delta table whose size will increases gradually now we have around 1.5 crores of rows while running vacuum command on that table i am getting the below error.ERROR: Job aborted due to stage failure: Task 7 in stage 491.0 failed 4 times, most...
- 1559 Views
- 1 replies
- 2 kudos
- 2 kudos
Do you have access to the Executor 7 logs? is there a high GC or some other events that is making the heartbeat timeout? would you be able to check the failed stages?
- 2 kudos
- 1433 Views
- 0 replies
- 1 kudos
- 1433 Views
- 0 replies
- 1 kudos