cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Restricting Spark Connect Behind Premium Plan Paywall?

gandersen-codes
New Contributor II

Quoting the databricks-connect docs, "For Databricks Runtime 13.0 and above, Databricks Connect is now built on open-source Spark Connect." What is odd to me is that a requirement for utilizing this open source Spark feature on Databricks, is Unity Catalog, which requires a premium Databricks plan.

I would understand if this was a restriction in databricks-connect proper, that power-users could bypass by simply using the native Spark Connect, but using Spark Connect directly to connect to a cluster outside of a Unity enabled workspace also does not work.

What is this reasoning for this restriction other than pushing users onto premium plans? Eventually non-premium/Unity users will not be able to use any form of databricks-connect once Databricks Runtime 12 is discontinued. Is there any plan for addressing this restriction?

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group