ColibriMike
Databricks Partner
"context_based_upload_for_execute": true

in projects.json allowed the code to run - but ended with

RuntimeError: Cannot start a remote Spark session because there is a regular Spark session already running.