For some reason, my dbconnect failed and I haven't been able to resolve the issue. I am connecting to an enterprise server. I was getting the following errors which (I believe) are now resolved.
I defined the PYSPARK_DRIVER_PYTHON and PYSPARK_PYTHON variables to the correct location. I then downloaded the hadoop binaries online, stored the directory in my environment and set HADOOP_HOME variable to that directory. I set these paths using <conda env config vars set my_var=value>
Now, I'm getting the below output. I can't tell if there's still some environment changes I need to make or if the problem is 'Invalid Shard Address'. I think it's the former because the shard address I'm inputting is correct. Any help appreciated