Need help to analyze databricks logs for a long-running job.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-06-2022 08:14 AM
Hi Team,
We have a job it completes in 3 minutes in one Databricks cluster, if we run the same job in another databricks cluster it is taking 3 hours to complete.
I am quite new to Databricks and need your guidance on how to find out where databricks spend a long-time during execution job. Any specific things I can check in Executor/driver logs?
Regards,
Rajesh.
Labels:
- Labels:
-
Databricks Cluster
-
Databricks Logs
-
Logs