cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Issue when connecting with Databricks cluster 15.4 without unity catalog using databricks connect

prasidataengine
New Contributor II

Hi,

I have a shared cluster created on databricks which uses 15.4 runtime.
I dont want to enable the unity catalog for this cluster.
Previously I used python 3.9.13 version to connect to 11.3 cluster using databricks connect 11.3
Now my company has restricted python 3.9 and we must use python 3.12.
I have installed databricks-connect 15.4 and using python 3.12.
when i do databricks-connect test , I get the below error: 
pyspark.errors.exceptions.connect.SparkConnectGrpcException: BAD_REQUEST: SingleClusterComputeMode(xxx-xxxx-xxxxx) is not Shared or Single User Cluster. (requestId=dcd4fa22-5cf5-4a42-9e52-c03058f7c32b)
WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
E0000 00:00:1739548060.674965 22836 init.cc:232] grpc_wait_for_shutdown_with_timeout() timed out.
Please help me to fix this error or alternative solution to work with python 3.12 and databricks-connect using vs code without unity catalog enabled

2 REPLIES 2

Alberto_Umana
Databricks Employee
Databricks Employee

Hi @prasidataengine,

For DBR runtime 13.3 LTS and above you must have Unity Catalog enabled to be able to use databricks-connect.

https://docs.databricks.com/en/dev-tools/databricks-connect/cluster-config.html

  Thanks for the reply. is there any other option available?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group