06-25-2021 12:50 PM
I have a spark-submit job, I do not see auto-scaling happening on the cluster at the time of executions.
06-25-2021 12:51 PM
This is working as expected. Autoscaling is not available for spark-submit jobs
Run the job as jar job instead of spark-submit
View solution in original post
never-displayed
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.
