topic Re: Change the default_catalog_name for a Unity Metastore assignment in Data Governance

Change the default_catalog_name for a Unity Metastore assignment

113266 — Mon, 10 Oct 2022 13:30:30 GMT

Is there anyway to do this? From looking through the docs it seems like it can be set programmatically via CLI/Terraform but requires the assignment to removed first.

The reason I need this is because the default is currently hive_metastore and when that happens SHOW DATABASES only shows "default". This is causing Looker (and other JDBC connections) problems as they can't introspect the schemas/catalogs.

Re: Change the default_catalog_name for a Unity Metastore assignment

karthik_p — Thu, 13 Oct 2022 14:22:26 GMT

@Rob Myers Just curious to know, have you migrated all your data into new metastore from hive_metastore. because hive_metastore that you are seeing is just not a part of unity catalog meta store, it is just mounted, and we won't be benefited with all security features that unity catalog provides until you upgrade your tables from legacy hive. coming to your question to change default catalog please try to use below config and see spark.databricks.sql.initial.catalog.name hive_metastore

Re: Change the default_catalog_name for a Unity Metastore assignment

113266 — Thu, 13 Oct 2022 15:54:01 GMT

Not migrated - this is a new instance scratch.

I can't set that parameter for SQL warehouses.

Re: Change the default_catalog_name for a Unity Metastore assignment

karthik_p — Thu, 13 Oct 2022 16:32:29 GMT

@Rob Myers please login to SQL --> SQL Admin Console --> SQL Warehouse Settings (SQL Config parameters and try ) , if not use any warehouse and open sql editor and set below query

%sql

SET spark.databricks.sql.initial.catalog.name = hive_metastore;

Re: Change the default_catalog_name for a Unity Metastore assignment

113266 — Fri, 14 Oct 2022 10:35:19 GMT

Unfortunately neither of those work, dont think that parameter has been allowed for setting in SQL warehouses.

Also on a general purpose cluster is denied as it is a static configuration which needs to be done at start up.