@James Smith You can reach out to Michael.Dibble@guycarp.com or please follow this doc;https://docs.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request
Did the GC cycle happen after the cp command? The memory will be reclaimed based on the requirement for the new coming objects. We do not explicitly clean any memory.. it is taken care by the JVM.and yes ideally it should, the unreferenced objects ar...
@James Smith The current implementation of dbutils.fs is single-threaded, meaning that regardless of whether it’s executed on the driver or inside a Spark job, it will perform recursive operations in a single-threaded loop.The current implementation...
