cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

How to resolve problem with upgrading external table to Unity Catalog?

vexor
Contributor

I have a problem with upgrading table to Unity Catalog, I got the error:

summary:

Error in SQL statement:

AnalysisException:

org.apache.hadoop.hive.ql.metadata.HiveException:

Unable to fetch table calexception. Exception thrown when executing query :

SELECT DISTINCT 'org.apache.hadoop.hive.metastore.model.MTable' AS NUCLEUS_TYPE,A0.CREATE_TIME,A0.LAST_ACCESS_TIME,A0.OWNER,A0.RETENTION,A0.IS_REWRITE_ENABLED,A0.TBL_NAME,A0.TBL_TYPE,A0.TBL_ID FROM TBLS A0 LEFT OUTER JOIN DBS B0 ON A0.DB_ID = B0.DB_ID WHERE A0.TBL_NAME = ? AND B0.`NAME` = ?; UpgradeTableCommand `ps_dev`.`dd_omp`.`calexception`, `hive_metastore`.`dd_omp`.`calexception`, false, true, false, false, false , data: com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException:

Did anybody have ever similar problem with upgrading external tables to Unity Catalog? I couldn't find a single clue about this issue. Full error message is attached.

This is my spark config in Cluster:

spark.sql.hive.metastore.version 1.2.1

hive.metastore.schema.verification.record.version false

spark.databricks.service.port 8787

spark.databricks.driver.enableUserContextForPythonAndRCommands true

spark.sql.hive.metastore.jars /dbfs/databricks/hive_metastore_jars/*

hive.metastore.schema.verification false

spark.databricks.delta.preview.enabled true

spark.databricks.service.server.enabled true

15 REPLIES 15

vexor
Contributor

Hi Vidula,

Unfortunately none of the answers answered my question.

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!