The spark context has stopped and the driver is restarting. Your notebook will be automatically
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-07-2024 11:13 PM
I am trying to execute a scala jar in notebook. When I execute it explicitly I am able to run the jar like this :
but when I am trying to run a notebook through databricks workflow I get the below error : The spark context has stopped and the driver is restarting. Your notebook will be automatically reattached.
Steps I have taken till now :
tried increasing spark driver memory like this :