Hi, 

Iam using databricks connect to compute with databricks cluster. I need to set some spark configurations, namely spark.files.ignoreCorruptFiles. As I have experienced, setting spark configuration in databricks connect for the current session, has no effect. Also I cannot configure the cluster itself, as it is shared cluster. Any solution ?