cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Unable to use unity catalog in notebook

harraz
New Contributor III
com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: org.apache.spark.sql.connector.catalog.CatalogNotFoundException: Catalog 'uc-dev' plugin class not found: spark.sql.catalog.uc-dev is not defined
....

I get the above when I reference the unity catalog.

Below is the cell that produced this error

%sql
-- Resetting both catalog and schema
USE catalog `uc-dev`;
USE DATABASE uc-dev.myschema;
SELECT current_database(), current_catalog();

Any help is much appreaciated

3 REPLIES 3

karthik_p
Esteemed Contributor

@mohamed harraz​ can you please make sure if uc-dev catalog exists 2. please make sure cluster you are using is UC enabled (access mode: single/shared)

Anonymous
Not applicable

Hi @mohamed harraz​ 

We haven't heard from you since the last response from @karthik p​ ​, and I was checking back to see if her suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others. 

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Tomas
New Contributor II

I had the same error plugin class not found: spark.sql.catalog... is not defined immediately after attaching the workspace into Unity catalog.

The error was resolved by restarting SQL Warehouse.

It seems that if SQL Warehouse (or any cluster) is running at the time the workspace is attached into Unity catalog, then it shows this error.

Maybe it is a bug as the Unity catalog was visible in the Catalog menu directly, but all operations on top of this catalog were not working until the compute restart?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group