- Listing directories in common is at least 4-8 times faster than Lakehouse environment.

 

Are you able to replicate the issue using simple a dbutils list operation (dbutils.fs.ls) or by performing a sample file (say 100 MB file) copy using dbutils.fs.cp? It would be good to isolate it by performing simple operations in both environments. If you can reproduce the behavior with dbutils, then try using curl to download a file by generating a pre-signed url from the blob storage. If the simple curl test can reproduce the issue, then you may need to review the network setup difference between both environments.