- 9131 Views
- 6 replies
- 7 kudos
Can I delete hive_metastore on a Unity Catalog Workspace?
Hi, I have a new workspace that was converted to be controlled via Unity Catalog.There is not data stored here as this is not in use yet, so I wanted to ask if it was safe to remove this without breaking the workspace?Thank you
- 9131 Views
- 6 replies
- 7 kudos
- 7 kudos
As things gravitate towards Unity Catalog, it would indeed be nice to have the the ability to completely remove Hive from existing setups.
- 7 kudos
- 5157 Views
- 4 replies
- 1 kudos
Mutliple Hive catalogs
Hello,Is it possible to use multiple Hive catalogs with Databricks? I know it can be done with Unity Catalog, but we're the only workspace admins in our organization. As far as I understand, we'd need account-level access to set up Unity Catalog.Best...
- 5157 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @Chris Nawara​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so ...
- 1 kudos
- 4255 Views
- 4 replies
- 1 kudos
"Create external Hive function is not supported in Unity Catalog" when registering Hive UDFs
I have enabled Unity Catalog in my AWS Databricks workspace, switching from the standard Hive Metastore. I have a few custom Hive UDFs in a JAR file that I have copied to /databricks/jars/ folder through init script. I want to be able to register tho...
- 4255 Views
- 4 replies
- 1 kudos
- 1 kudos
Hi @Franklin George​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...
- 1 kudos
- 2010 Views
- 2 replies
- 2 kudos
Reading Athen table created on top of s3 in databricks
HI,we have databricks that use aws glue catalog as metastore, I am trying to read athena table which is created on top s3, I am getting following errorcom.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: java.lang.RuntimeExc...
- 2010 Views
- 2 replies
- 2 kudos
- 2 kudos
@Daniel Sahal​ at org.apache.hadoop.hive.ql.plan.TableDesc.getDeserializerClass(TableDesc.java:79) at org.apache.spark.sql.hive.execution.HiveTableScanExec.addColumnMetadataToConf(HiveTableScanExec.scala:127) at org.apache.spark.sql.hive.execution.Hi...
- 2 kudos
- 1784 Views
- 1 replies
- 0 kudos
The issue with SQL-endpoint + external hive metastore
HiWe have faced an issue recently (everything worked well 1 week before)We are using exnernal hive metastore:"spark.hadoop.datanucleus.connectionPool.maxPoolSize" : "10" "spark.sql.hive.metastore.jars" : "/dbfs/ivyjars/*" "spark.sql.hive.metastor...
- 1784 Views
- 1 replies
- 0 kudos
- 0 kudos
Generally, this should not be a case. Please raise a support request to databricks
- 0 kudos
- 2272 Views
- 0 replies
- 1 kudos
Shared Hive External Metastore Drop table issue
hi Team ,We are using a shared hive metastore for connecting to dev and prod as we need cross DB access for certain ML use-cases.Currently we are having issues as "DROP TABLE COMMAND" directly drops the table without checking the underlying locationH...
- 2272 Views
- 0 replies
- 1 kudos
- 6134 Views
- 2 replies
- 4 kudos
Resolved! Compatibility of Hive metastore schema version and Databricks 9.1 LTS
I found a page that tells the compatibility between Databricks and Hive metastore versions: https://docs.microsoft.com/en-us/azure/databricks/data/metastores/external-hive-metastoreBut the information is only up to Databricks 7.1. Anywhere I can find...
- 6134 Views
- 2 replies
- 4 kudos
- 4 kudos
it still should work with 7.x +. version. Are you seeing any issue on your cluster ? @Jeffrey Mak​
- 4 kudos