cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Default Catalog Name setting doesn't work

ThomasVanBilsen
New Contributor III

I've recently started using Unity Catalog and I'm trying to set the default catalog name to something else than the hive_metastore for some of my workspaces.

According to the documentation (Update an assignment | Metastores API | REST API reference | Azure Databricks) the default catalog can be changed for a workspace by using the REST API. 

I've tried this; but so far unsuccessfully. After running the "Update an assignment" request the value seems to be changed successfully, as you can see in the screenshot below.

ThomasVanBilsen_0-1691046243104.png

 

Yet when I execute a query from a notebook within this workspace it still seems to refer to the hive_metastore when I don't specify the catalog name. 

ThomasVanBilsen_1-1691048305156.png

 

Any ideas on what could be causing this are more than welcome! 

2 REPLIES 2

youssefmrini
Honored Contributor III

I would recommend to use the Spark conf at a cluster level to change the default Catalog.  For the rest API i believe it works only for SQL Warehouse.

saldroubi
New Contributor II

I found that setting the default catalog in the workspace "Admin Settings" works for Sql warehouse, spark cluster and compute polices. 

Consult this documentation : https://docs.databricks.com/en/data-governance/unity-catalog/create-catalogs.html#view-the-current-d...

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group