you can ssh into your cluster if you configured it with a public key at creation time. BUT this question is still relevant because I am having trouble deleting files in the /dbfs directory. I accidentally ended up creating a huge number of streams with different chekcpoints paths in my top level dbfs directory. now when I try to

rm -rf checkpoint_path

, it takes FOREVER to delete. And I can't use my cluster since they consume so much memory. They wont even go away when I make an entirely new cluster!