If you want delete recursively you need to add True. Deleting is faster so I think it doesn't make sense to orchestrate whole pipeline.

dbutils.fs.rm('/path', True)


My blog: https://databrickster.medium.com/