topic Re: Hive metastore federation, internal and external unable to connect in Data Engineering

Hive metastore federation, internal and external unable to connect

johnnwanosike — Wed, 08 Jan 2025 17:55:14 GMT

I enabled the internal hive on the metastore federation using this query command

CREATE CONNECTION IF NOT EXISTS internal-hive TYPE hive_metastore
OPTIONS (builtin true);

But I can't get a password or username to access the JDBC URL.

Re: Hive metastore federation, internal and external unable to connect

Walter_C — Wed, 08 Jan 2025 18:37:50 GMT

Have you tried using token as username and use a valid PAT token as your password?

Re: Hive metastore federation, internal and external unable to connect

johnnwanosike — Wed, 08 Jan 2025 19:01:10 GMT

Yes, I got this error.

Access denied for user 'token'@'185.59.*****' (using password: YES)

Re: Hive metastore federation, internal and external unable to connect

Walter_C — Wed, 08 Jan 2025 20:10:57 GMT

Can you share with me the JDBC connection string you are running? you can remove any sensitive data if needed

Re: Hive metastore federation, internal and external unable to connect

johnnwanosike — Wed, 08 Jan 2025 20:46:19 GMT

Below is my hive configuration

<name>javax.jdo.option.ConnectionDriverName</name>

<value>com.mysql.jdbc.Driver</value>

</property>

<name>javax.jdo.option.ConnectionURL</name>

<value>jdbc:mysql://35.239.****:3306/organization4589753****</value>

</property>

<name>javax.jdo.option.ConnectionUserName</name>

</property>

<name>javax.jdo.option.ConnectionPassword</name>

</property>

The configure below is that of hive metastore federation I created:

URLDatabaseHome workspace idHostPortInternal

jdbc://35.23*.***:3306/organization45897****935

organization458975****7935

458975*****7935

35.239.**.***

3306

true

I tried using Dbeaver to connect but it failed also

Re: Hive metastore federation, internal and external unable to connect

Walter_C — Wed, 08 Jan 2025 21:15:27 GMT

Oh ok, so you are connecting from Databricks cluster to MySQL, on this case the username and password needs to be the one for the MySQL database

Re: Hive metastore federation, internal and external unable to connect

johnnwanosike — Wed, 08 Jan 2025 22:12:00 GMT

Not really, what I want to achieve is connecting to an external hive but I do want to configure the external hive on our server to be able to interact with the Databricks cluster in such a way that I could have access to thrift protocol.