Hi,
I have created a new UC enabled metastore using an Azure storage account and container connected to a Databricks workspace using an access connector. At first glance everything seems to work.
I encounter a problem, however, when I try to query UC using a shared access mode cluster. I get an error,
`org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient`
which seems to be caused by the exception, `SparkConnectGrpcException`, which gets thrown by the SparkConnectClient after informing me that it "cannot invoke RPC" and and that "closed" is contained in the grpc.RpsError.
What am I doing wrong, and how can I fix it?
Note:
- There is no problem, when I use SQL Warehouses or single mode access clusters.
- I have a metastore in a different region (West Europe) that doesn't experience this problem
- The problematic workspace/metastore is located in North Europe
