How to filter the Spark UI for a notebook
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-26-2023 08:43 AM
When running spark under yarn each script has it's own self contained set of logs:-
In databricks all I see if a list of jobs and stages that have been run on the cluster:-
From a support perspective this is a nightmare.
How can notebooks logs be grouped together so it is possible to see the all the activities that notebook has performed?
Labels:
- Labels:
-
Databricks Notebooks
-
Logs
-
Spark ui