I'm running pyspark through databricks-connect and getting an error saying

```

ERROR SparkClientManager: Fail to get the SparkClient

java.util.concurrent.ExecutionException: com.databricks.service.SparkServiceConnectionException: Invalid shard address:

```

followed by my workspace address "https://dbc-xxxxxxxx-xxxx.cloud.databricks.com"

I didn't make any modifications or updates to my python or databricks-connect installation. How can I resolve this issue?

I have looked at a similar thread https://community.databricks.com/s/topic/0TO3f000000CmP9GAK/invalid-shard-address but that discussion did not provide any useful solution to solve my issue.