Connect from Databricks to Hbase HDinsight cluster.

[Vadim1]

Hi, I have Databricks installation in Azure. I want to run a job that connects to HBase in a separate HDinsight cluster.

What I tried:

1. Created a peering between base cluster and Databricks vNets.
2. I can ping IPs of Hbase zookeeper nodes but I cannot access them by domain name (zk1.abc.net, etc). That's why I'm getting timeout and host-not-found errors.

As I understand I need to set up a DNS to be able to communicate with Hbase but I cannot change Databricks DNS (locked by Databricks security policy).

Can you help me with this, please?

Maybe you can refer to the guide that I can use?

Thanks.

[-werners-]

@Vadim Z​, Could it be a permission setting for your user?

Because you can change DNS settings on Databricks (f.e. https://kb.databricks.com/cloud/custom-dns-routing.html)

[Vadim1 · Accepted solution]

Thanks for the response, werners. I found that my Databricks cluster was created with a private virtual network that cannot be changed, so I deployed a new Databricks cluster with my own virtual network and this resolved all issues with connectivity.

[User16764241763]

Vadim,

Thank you for the response. Appreciate it.