Thanks for the quick response.

Regarding the suggested AWS data sync approach, we have tried data sync in multiple ways, it is creating folders in s3 bucket itself not on DBFS. As our task is to copy from bucket to DBFS.

It seems that it only supports bucket level operations not DBFS level.

Please suggest any best practices/approach which can cater our needs. That'll be a great help. Thanks.