@Ashwin_DSA  I agree with your thought. I’ve been using a similar Python-based solution in Databricks to download a few GBs of data, and it has worked reliably so far.

Rohan