@Kaviprakash thanks for your question!

Is this also probably specific to a cluster type ? Shared vs Single user?

If Shared Mode, can you please try restarting your cluster with the following Spark Configuration:
spark.connect.perserveOptionCasing true