cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to pass HBase-site.xml to a Databricks job?

Vadim1
New Contributor III

Hi, I have Azure Hbase cluster and Databricks. I want to run jobs on Databricks that write data to Hbase. 

To connect to Hbase I need to get Hbase-site.xml and have it in the classpath or env of a job.

Question: How can I run the Databricks job with an attached Hbase-site.xml file?

Previously I have used a spark-submit command that allows passing additional configs. I cannot find any documented way to do it.

Is there any other way to read config directly from Hbase cluster?

Thanks.

2 REPLIES 2

Hubert-Dudek
Esteemed Contributor III

https://github.com/hortonworks-spark/shc - but not sure is it working with databricks

If you have a budget and want an easy solution, there is also JDBC driver https://www.cdata.com/kb/tech/hbase-jdbc-azure-databricks.rst

jose_gonzalez
Moderator
Moderator

Hi @Vadim Zโ€‹,

Just a friendly follow-up. Did the response from Hubert help you to resolve your issues? let us know if you still are looking for help

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.