https://community.databricks.com/t5/data-engineering/spark-sql-is-suddenly-giving-an-error-quot-unable-to-instantiate/m-p/81672#M36391 <P>spark.sql() is suddenly giving an error "Unable to instantiate org.apache.hadoop.hive.metastore.Hive<SPAN>MetaStoreClient" on databricks jobs and python scripts that worked last month.&nbsp; No local changes on my end.</SPAN></P><P>What could be the cause of this and what should I be looking at?</P><P><SPAN>Traceback (most recent call last): File "&lt;string&gt;", line 1, in &lt;module&gt; File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/session.py", line 503, in sql data, properties = self.client.execute_command(cmd.command(self._client)) File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 892, in execute_command data, _, _, _, properties = self._execute_and_fetch(req) File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 1172, in _execute_and_fetch for response in self._execute_and_fetch_as_iterator(req): File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 1153, in _execute_and_fetch_as_iterator self._handle_error(error) File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 1308, in _handle_error self._handle_rpc_error(error) File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 1344, in _handle_rpc_error raise convert_exception(info, status.message) from None pyspark.errors.exceptions.connect.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient</SPAN></P> Fri, 02 Aug 2024 15:29:48 GMT copper-carrot 2024-08-02T15:29:48Z https://community.databricks.com/t5/data-engineering/spark-sql-is-suddenly-giving-an-error-quot-unable-to-instantiate/m-p/81672#M36391 <P>spark.sql() is suddenly giving an error "Unable to instantiate org.apache.hadoop.hive.metastore.Hive<SPAN>MetaStoreClient" on databricks jobs and python scripts that worked last month.&nbsp; No local changes on my end.</SPAN></P><P>What could be the cause of this and what should I be looking at?</P><P><SPAN>Traceback (most recent call last): File "&lt;string&gt;", line 1, in &lt;module&gt; File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/session.py", line 503, in sql data, properties = self.client.execute_command(cmd.command(self._client)) File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 892, in execute_command data, _, _, _, properties = self._execute_and_fetch(req) File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 1172, in _execute_and_fetch for response in self._execute_and_fetch_as_iterator(req): File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 1153, in _execute_and_fetch_as_iterator self._handle_error(error) File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 1308, in _handle_error self._handle_rpc_error(error) File "/home/mbarlett/projects/ds-pipelines/.venv/lib/python3.10/site-packages/pyspark/sql/connect/client/core.py", line 1344, in _handle_rpc_error raise convert_exception(info, status.message) from None pyspark.errors.exceptions.connect.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient</SPAN></P> Fri, 02 Aug 2024 15:29:48 GMT https://community.databricks.com/t5/data-engineering/spark-sql-is-suddenly-giving-an-error-quot-unable-to-instantiate/m-p/81672#M36391 copper-carrot 2024-08-02T15:29:48Z https://community.databricks.com/t5/data-engineering/spark-sql-is-suddenly-giving-an-error-quot-unable-to-instantiate/m-p/82060#M36500 <P>I am not aware of any recent changes and don't know what changes might solicit this sort of error.</P> Tue, 06 Aug 2024 14:43:07 GMT https://community.databricks.com/t5/data-engineering/spark-sql-is-suddenly-giving-an-error-quot-unable-to-instantiate/m-p/82060#M36500 copper-carrot 2024-08-06T14:43:07Z