cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

TonyUK
by New Contributor II
  • 8732 Views
  • 6 replies
  • 7 kudos

Can I delete hive_metastore on a Unity Catalog Workspace?

Hi, I have a new workspace that was converted to be controlled via Unity Catalog.There is not data stored here as this is not in use yet, so I wanted to ask if it was safe to remove this without breaking the workspace?Thank you

  • 8732 Views
  • 6 replies
  • 7 kudos
Latest Reply
JasonThomas
New Contributor III
  • 7 kudos

As things gravitate towards Unity Catalog, it would indeed be nice to have the the ability to completely remove Hive from existing setups.

  • 7 kudos
5 More Replies
knawara
by Contributor
  • 4917 Views
  • 4 replies
  • 1 kudos

Mutliple Hive catalogs

Hello,Is it possible to use multiple Hive catalogs with Databricks? I know it can be done with Unity Catalog, but we're the only workspace admins in our organization. As far as I understand, we'd need account-level access to set up Unity Catalog.Best...

  • 4917 Views
  • 4 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Chris Nawara​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so ...

  • 1 kudos
3 More Replies
FRG96
by New Contributor III
  • 4039 Views
  • 4 replies
  • 1 kudos

"Create external Hive function is not supported in Unity Catalog" when registering Hive UDFs

I have enabled Unity Catalog in my AWS Databricks workspace, switching from the standard Hive Metastore. I have a few custom Hive UDFs in a JAR file that I have copied to /databricks/jars/ folder through init script. I want to be able to register tho...

Hive Permanent Function Error
  • 4039 Views
  • 4 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @Franklin George​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...

  • 1 kudos
3 More Replies
HemanthRatakond
by New Contributor II
  • 1806 Views
  • 2 replies
  • 2 kudos

Reading Athen table created on top of s3 in databricks

HI,we have databricks that use aws glue catalog as metastore, I am trying to read athena table which is created on top s3, I am getting following errorcom.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: java.lang.RuntimeExc...

  • 1806 Views
  • 2 replies
  • 2 kudos
Latest Reply
HemanthRatakond
New Contributor II
  • 2 kudos

@Daniel Sahal​ at org.apache.hadoop.hive.ql.plan.TableDesc.getDeserializerClass(TableDesc.java:79) at org.apache.spark.sql.hive.execution.HiveTableScanExec.addColumnMetadataToConf(HiveTableScanExec.scala:127) at org.apache.spark.sql.hive.execution.Hi...

  • 2 kudos
1 More Replies
vpismarev
by New Contributor
  • 1571 Views
  • 1 replies
  • 0 kudos

The issue with SQL-endpoint + external hive metastore

HiWe have faced an issue recently (everything worked well 1 week before)We are using exnernal hive metastore:"spark.hadoop.datanucleus.connectionPool.maxPoolSize" : "10"   "spark.sql.hive.metastore.jars" : "/dbfs/ivyjars/*"   "spark.sql.hive.metastor...

  • 1571 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 0 kudos

Generally, this should not be a case. Please raise a support request to databricks

  • 0 kudos
Soma
by Valued Contributor
  • 2240 Views
  • 0 replies
  • 1 kudos

Shared Hive External Metastore Drop table issue

hi Team ,We are using a shared hive metastore for connecting to dev and prod as we need cross DB access for certain ML use-cases.Currently we are having issues as "DROP TABLE COMMAND" directly drops the table without checking the underlying locationH...

  • 2240 Views
  • 0 replies
  • 1 kudos
jeffreym9
by New Contributor III
  • 6033 Views
  • 2 replies
  • 4 kudos

Resolved! Compatibility of Hive metastore schema version and Databricks 9.1 LTS

I found a page that tells the compatibility between Databricks and Hive metastore versions: https://docs.microsoft.com/en-us/azure/databricks/data/metastores/external-hive-metastoreBut the information is only up to Databricks 7.1. Anywhere I can find...

  • 6033 Views
  • 2 replies
  • 4 kudos
Latest Reply
Atanu
Databricks Employee
  • 4 kudos

it still should work with 7.x +. version. Are you seeing any issue on your cluster ? @Jeffrey Mak​ 

  • 4 kudos
1 More Replies
Labels