cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
User16869510359
by • Esteemed Contributor
  • 950 Views
  • 1 replies
  • 1 kudos

Resolved! How many active connections are made to Hive metastore

We are using an internal metastore implementation. ie the metastore is hosted at the Dataricks side. However, we believe the metastore instance made available for my workspace is not adequate enough to handle the load. How can I monitor the number of...

Data Engineering
Reply
  • 950 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
User16869510359
Esteemed Contributor
  • 1 kudos

Use the below code snippet from a notebook%scala import java.sql.Connection import java.sql.DriverManager import java.sql.ResultSet import java.sql.SQLException   /** * For details on what this query means, checkout https://dev.mysql.com/doc/refma...

  • 1 kudos
aladda
by • Honored Contributor II
  • 765 Views
  • 1 replies
  • 0 kudos

Resolved! Can you publish results of a Delta Live Table pipeline to a database in the metastore?

Data Engineering
Reply
  • 765 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
aladda
Honored Contributor II
  • 0 kudos

Yes. You can specify a "target" database as part of your DLT pipeline configuration to publish results to a target database in the metastore. See - https://docs.databricks.com/data-engineering/delta-live-tables/delta-live-tables-quickstart.html#publi...

  • 0 kudos
User16783853906
by • Contributor III
  • 3177 Views
  • 1 replies
  • 0 kudos

Metaexception [Version information not found in metastore] during cluster [re]start

Trying to configure new external metastore and running into the following exception during cluster initialization - Caused by: MetaException(message:Version information not found in metastore. )   at org.apache.hadoop.hive.metastore.RetryingHMSHandl...

Data Engineering
Reply
  • 3177 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
User16783853906
Contributor III
  • 0 kudos

The above exception happens when the hive schema is not available in the metastore instance. Please check in your init scripts to make sure the following flag is enabled to create hive Schema and tables if not already present. datanucleus.autoCreateA...

  • 0 kudos
Labels