@Retired_mod Thank you for the response but none of this seems valid for current databricks-connect versions. 

1. As far as I can tell there is no `databricks-connect` CLI in the current versions so `databrick-connect configure` will not work
2. `spark.conf.set` yields error: cannot modify the value of the Spark config: "spark.submit.pyFiles". This is a no go since spark 3.0, see: here

If I am missing something, could you provide a working example of your last response?