Hi, I have Databricks installation in Azure. I want to run a job that connects to HBase in a separate HDinsight cluster.

What I tried:

1. Created a peering between base cluster and Databricks vNets.
2. I can ping IPs of Hbase zookeeper nodes but I cannot access them by domain name (zk1.abc.net, etc). That's why I'm getting timeout and host-not-found errors.

As I understand I need to set up a DNS to be able to communicate with Hbase but I cannot change Databricks DNS (locked by Databricks security policy).

Can you help me with this, please?

Maybe you can refer to the guide that I can use?

Thanks.