databricks-jdbc lists `spark_catalog` among catalogs for Standard tier Azure workspace

HakanNordgren
New Contributor II

‎03-13-2024 05:41 AM

databricks-jdbc lists `spark_catalog` among catalogs for Standard tier Azure workspace. The UI lists `hive_metastore`. It would be better if these two were consistent.

0 Kudos

HakanNordgren
New Contributor II
In response to Retired_mod

‎03-19-2024 10:36 AM

@Retired_mod : Could I convince you to add the above as a bug to the backlog?

0 Kudos

HakanNordgren
New Contributor II
In response to HakanNordgren

‎03-20-2024 06:19 AM

Also, @Retired_mod : Is it possible to have both a `hive_metastore` catalog and a `spark_catalog` catalog.

0 Kudos

MichTalebzadeh
Valued Contributor
In response to HakanNordgren

‎03-20-2024 02:25 PM

short answer is no

Databricks uses a single catalog -> Unity Catalog for managing tables created with Hive or Spark SQL, simplifying things. In spark sql you can do

spark-sql (default)> show catalogs;
spark_catalog

HTH

 

 

 

 

Mich Talebzadeh | Technologist | Data | Generative AI | Financial Fraud
London
United Kingdom

view my Linkedin profile



https://en.everybodywiki.com/Mich_Talebzadeh



Disclaimer: The information provided is correct to the best of my knowledge but of course cannot be guaranteed . It is essential to note that, as with any advice, quote "one test result is worth one-thousand expert opinions (Werner Von Braun)".
0 Kudos