dlorenzo
Databricks Partner

Thank you very much for the detailed explanation, you are totally right! My issue was that I specified startVersion instead of startingVersion, so spark silently ignored the option, tipical spark config issue.