cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

How to pass HBase-site.xml to a Databricks job?

Vadim1
New Contributor III

Hi, I have Azure Hbase cluster and Databricks. I want to run jobs on Databricks that write data to Hbase. 

To connect to Hbase I need to get Hbase-site.xml and have it in the classpath or env of a job.

Question: How can I run the Databricks job with an attached Hbase-site.xml file?

Previously I have used a spark-submit command that allows passing additional configs. I cannot find any documented way to do it.

Is there any other way to read config directly from Hbase cluster?

Thanks.

2 REPLIES 2

Hubert-Dudek
Esteemed Contributor III

https://github.com/hortonworks-spark/shc - but not sure is it working with databricks

If you have a budget and want an easy solution, there is also JDBC driver https://www.cdata.com/kb/tech/hbase-jdbc-azure-databricks.rst

jose_gonzalez
Databricks Employee
Databricks Employee

Hi @Vadim Zโ€‹,

Just a friendly follow-up. Did the response from Hubert help you to resolve your issues? let us know if you still are looking for help

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group