Problem in VS Code Extention

DatabricksEngi1
Contributor

‎10-18-2025 09:17 PM

Until a few days ago, I was working with Databricks Connect using the VS Code extension, and everything worked perfectly.

In my .databrickscfg file, I had authentication configured like this:

 

 
[name]
host:
token:
 

When I ran my code, everything worked fine - it connected to Serverless by default.

Then, I added a new authentication profile in .databrickscfg because I wanted to use a specific cluster instead of Serverless:

 

 
[name]
host:
token:
cluster_id:

 

 

Since then, I haven’t been able to run any code from VS Code.
I keep getting the following error:

 

 
[CONNECT_URL_NOT_SET] Cannot create a Spark Connect session because the Spark Connect remote URL has not been set. Please define the remote URL by setting either the 'spark.remote' option or the 'SPARK_REMOTE' environment variable.
 

Even after reverting .databrickscfg to the previous working configuration, it still doesn’t work.

I also tried setting the SPARK_REMOTE environment variable (which I hadn’t done before), but now the code starts running and then fails after about a minute with a “maximum retries exceeded” message.

Has anyone else encountered this issue or knows how to fix it?
Thanks in advance.

0 Kudos