You could use shell commands, like %sh rm -r sampledir You need to check for the correct path before, I currently don't know where dbfs folders are exactly mounted
Depends on your logic. The source sends you a full load, this might mean that you need to reprocess everything, also in all downstream layers.If the source only sends you a full load, because it's not capable of identifying changes then you should do...