Hi @Daniel Vera​ , Thanks for the details. I am not sure about your data, but I hope adding multiple columns in partition does not ended up with small files.

Lets see if databricks provides an option to apply explicit lock on tables for parallel operations.