Databricks

Vadim1 · 06-23-2022

Hi, I have Azure Hbase cluster and Databricks. I want to run jobs on Databricks that write data to Hbase. To connect to Hbase I need to get Hbase-site.xml and have it in the classpath or env of a job.Question: How can I run the Databricks job with an...

Vadim1 · 06-03-2022

Hi, I'm trying to write data from RDD to the storage account:Adding storage account key:spark.conf.set("fs.azure.account.key.y.blob.core.windows.net", "myStorageAccountKey")Read and write to the same storage:val path = "wasbs://x@y.blob.core.windows....

Vadim1 · 05-30-2022

Hi, I have Databricks installation in Azure. I want to run a job that connects to HBase in a separate HDinsight cluster.What I tried:Created a peering between base cluster and Databricks vNets.I can ping IPs of Hbase zookeeper nodes but I cannot acce...

Vadim1 · 06-05-2022

Hi, thanks a lot aravish! This didn't work from a notebook but worked when I added it in Advanced options to spark config of the cluster:spark.hadoop.fs.azure.account.key.y.blob.core.windows.net key

Vadim1 · 06-02-2022

Thanks for the response, werners. I found that my Databricks cluster was created with a private virtual network that cannot be changed, so I deployed a new Databricks cluster with my own virtual network and this resolved all issues with connectivity.

Databricks

User Stats

User Activity

How to pass HBase-site.xml to a Databricks job?

Error on Azure-Databricks write RDD to storage account with wsabs://

Connect from Databricks to Hbase HDinsight cluster.

Re: Error on Azure-Databricks write RDD to storage account with wsabs://

Re: Connect from Databricks to Hbase HDinsight cluster.