I have tried that. It doesn't work and throw the error I mentioned above. (I did add recurse=True).

Even if I try to delete using %sh rm -rf, the same error occurs. All files get deleted except this folder: _delta_log. If I try to delete it, it gives the error I mentioned above