topic How can we connect to the databricks managed metastore in Data Engineering

How can we connect to the databricks managed metastore

AP — Mon, 01 Aug 2022 22:02:58 GMT

Hi, I am trying to take advantage of the treasure trove of the information that metastore contains and take some actions to improve performance. In my case, the metastore is managed by databricks, we don't use external metastore.

How can I connect to the metastore and query it. I scanned the cluster logs to see some entries that has the JDBC information, but the user ID is really vague and password of course not available.

Re: How can we connect to the databricks managed metastore

Prabakar — Mon, 01 Aug 2022 22:25:27 GMT

@AKSHAY PALLERLA to get the jdbc/odbc information you can get it from the cluster configuration.

In the cluster configuration page, under advanced options, you have JDBC/ODBC tab. Click on that tab and it should give you the details you are looking for.

Re: How can we connect to the databricks managed metastore

AP — Tue, 02 Aug 2022 01:46:01 GMT

Thanks Prabakar. I appreciate your response. However, I already have the details. Now, my question is what do I do with those details? I have the details in the following format

config=DbMetastoreConfig{host=somemetastoreprefix.mysql.database.azure.com, port=xxxx, dbName=orgnxxx, user=randomvalues@somemetastoreprefix})

DataSource Jdbc URL: jdbc:mariadb://somemetastoreprefix.mysql.database.azure.com:xxxx/orgxxx?useSSL=true&sslMode=VERIFY_CA&disableSslHostnameVerification=true&trustServerCertificate=false&serverSslCert=/databricks/common/mysql-ssl-ca-cert.crt

Specifying those in the options tab you in this case is not necessary since Databricks Run time will take care of establishing connectivity since it is a managed resource.