Resolved! Notebook failing in job-cluster but runs fine in all-purpose-cluster with the same configuration
I have a notebook with many join and few persist operations (which runs fine on all-purpose-cluster (with worker nodes - i3.xlarge and autoscale enabled), but the same notebook failing in job-cluster with the same cluster definition (to be frank the ...
- 3320 Views
- 1 replies
- 2 kudos
Latest Reply
Hi @Ajay Nanjundappa​ ,Check "Event log" tab. Search for any spot terminations events. It seems like all your nodes are spot instances. The error "FetchFailedException" is associated with spot termination nodes.
- 2 kudos