Invalid shard address
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-14-2022 05:23 AM
I'm running pyspark through databricks-connect and getting an error saying
```
ERROR SparkClientManager: Fail to get the SparkClient
java.util.concurrent.ExecutionException: com.databricks.service.SparkServiceConnectionException: Invalid shard address:
```
followed by my workspace address "https://dbc-xxxxxxxx-xxxx.cloud.databricks.com"
I didn't make any modifications or updates to my python or databricks-connect installation. How can I resolve this issue?
I have looked at a similar thread https://community.databricks.com/s/topic/0TO3f000000CmP9GAK/invalid-shard-address but that discussion did not provide any useful solution to solve my issue.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-15-2022 11:43 PM
hi @Marco Wong was this working before and failing now?
Are you behind a VPN or firewall? If so can you check by disabling it?
enable traces at wireshark and collected dump to check if there is traffic going to workspace?
Check if you can get curl working with Databricks rest api for anything (workspace, cluster manager.. etc)?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-16-2022 01:09 AM
Yes it was working before and now failing. I'm not behind a VPN/firewall. I'll try using wireshark and curl.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-16-2022 02:13 AM
curl works with the databricks api but databricks-connect still doesn't work with the invalid shard address error
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-30-2022 09:33 AM
Hi,
Just a friendly follow-up. Did you have time to try Prabakar's response? let us know if you still need help or not.
![](/skins/images/97567C72181EBE789E1F0FD869E4C89B/responsive_peak/images/icon_anonymous_message.png)
![](/skins/images/97567C72181EBE789E1F0FD869E4C89B/responsive_peak/images/icon_anonymous_message.png)