cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

DB Connect failing

pjp94
Contributor

For some reason, my dbconnect failed and I haven't been able to resolve the issue. I am connecting to an enterprise server. I was getting the following errors which (I believe) are now resolved.

image.pngI defined the PYSPARK_DRIVER_PYTHON and PYSPARK_PYTHON variables to the correct location. I then downloaded the hadoop binaries online, stored the directory in my environment and set HADOOP_HOME variable to that directory. I set these paths using <conda env config vars set my_var=value>

Now, I'm getting the below output. I can't tell if there's still some environment changes I need to make or if the problem is 'Invalid Shard Address'. I think it's the former because the shard address I'm inputting is correct. Any help appreciated

image.png

1 REPLY 1

Debayan
Databricks Employee
Databricks Employee

Hi, Could you please confirm if you are providing the right shard ID/URL? Also, please let us know which guide has been followed to configure the connectivity. Also, please provide the screenshot of the error after entering the shard URL.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group