Hi, Walter_C, I have tried to redirect the .log file to other destination. However, I found that redirection through create cluster→Advanced Options→Logging→Destination is a copy rather than a move. This means that the driver log will still increase. （The Spark UI of databricks is useless and cannot display any valid information, including memory usage of drivers and executors.

Finally, I reluctantly switched to a larger driver to solve this problem.