Cluster with shared access mode cannot query metastore

Administration & Architecture

Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.

Hi,

I have created a new UC enabled metastore using an Azure storage account and container connected to a Databricks workspace using an access connector. At first glance everything seems to work.

I encounter a problem, however, when I try to query UC using a shared access mode cluster. I get an error,

`org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient`

which seems to be caused by the exception, `SparkConnectGrpcException`, which gets thrown by the SparkConnectClient after informing me that it "cannot invoke RPC" and and that "closed" is contained in the grpc.RpsError.

What am I doing wrong, and how can I fix it?

Note:

- There is no problem, when I use SQL Warehouses or single mode access clusters.

- I have a metastore in a different region (West Europe) that doesn't experience this problem

- The problematic workspace/metastore is located in North Europe