Hi @harishgehlot ,

- Right, you can even opt for single node since you don't need any workers if you're only running Pandas to process the data.

- Yes, your right in that on-demand instances are preferable for long-running tasks because of that termination risk with spot instances, especially if your code isn't fault tolerant.

- I'm not sure of all the configurations you'd need based on your code and tasks, but you can add availability: ON_DEMAND to ensure it's not using spot instances.