Is catalog a feature in the community version?

THIAM_HUATTAN — Tue, 16 Aug 2022 12:19:46 GMT

%sql
create catalog if not exists catalog1

I tried above, but it gives me error as below:

com.databricks.backend.common.rpc.DatabricksExceptions$SQLExecutionException: org.apache.spark.sql.AnalysisException: Catalog namespace is not supported.

at com.databricks.sql.managedcatalog.ManagedCatalogErrors$.catalogNamespaceNotSupportException(ManagedCatalogErrors.scala:40)

at com.databricks.sql.managedcatalog.ExceptionManagedCatalog.createCatalog(ExceptionManagedCatalog.scala:60)

at com.databricks.sql.managedcatalog.ManagedCatalogSessionCatalog.createCatalog(ManagedCatalogSessionCatalog.scala:357)

at com.databricks.sql.managedcatalog.command.CreateCatalogCommand.run(CatalogCommands.scala:45)

at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:80)

at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:78)

at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:89)

at org.apache.spark.sql.execution.QueryExecution$$anonfun$$nestedInanonfun$eagerlyExecuteCommands$1$1.$anonfun$applyOrElse$1(QueryExecution.scala:160)

at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withCustomExecutionEnv$8(SQLExecution.scala:239)

at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:386)

at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withCustomExecutionEnv$1(SQLExecution.scala:186)

at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:968)

at org.apache.spark.sql.execution.SQLExecution$.withCustomExecutionEnv(SQLExecution.scala:141)

at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:336)

at org.apache.spark.sql.execution.QueryExecution$$anonfun$$nestedInanonfun$eagerlyExecuteCommands$1$1.applyOrElse(QueryExecution.scala:160)

at org.apache.spark.sql.execution.QueryExecution$$anonfun$$nestedInanonfun$eagerlyExecuteCommands$1$1.applyOrElse(QueryExecution.scala:156)

at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDownWithPruning$1(TreeNode.scala:575)

at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:167)

at org.apache.spark.sql.catalyst.trees.TreeNode.transformDownWithPruning(TreeNode.scala:575)

at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$super$transformDownWithPruning(LogicalPlan.scala:30)

at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning(AnalysisHelper.scala:268)

at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning$(AnalysisHelper.scala:264)

at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:30)

at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:551)

at org.apache.spark.sql.execution.QueryExecution.$anonfun$eagerlyExecuteCommands$1(QueryExecution.scala:156)

Re: Is catalog a feature in the community version?

Sascha_Vetter — Fri, 02 Sep 2022 18:48:59 GMT

Please check that your cluster (compute) works for Unity Catalog. See the screenshot and documentation for details.

Re: Is catalog a feature in the community version?

BradSheridan — Sat, 01 Oct 2022 16:11:17 GMT

For me, selecting Runtime 11.1 did not work (i.e. 'unity catalog' didn't show up on the right-hand side under Summary). But when I selected Runtime 11.2, it popped up. Going to start playing with it now

Re: Is catalog a feature in the community version?

Data_Analytics1 — Thu, 01 Dec 2022 13:36:34 GMT

@Sascha Vetter I am not seeing any option to enable Unity Catalog in Azure Databricks.

Configuration:

Databricks runtime version: 10.4 LTS (includes Apache Spark 3.2.1, Scala 2.12)

Standard_DS3_v2 14GB, 4 core is used.

Access mode: No Isolation shared.

What configuration I need to set to enable Unity Catalog?

Setting up the runtime to Runtime 11.2 is not working for me.

Re: Is catalog a feature in the community version?

Sascha_Vetter — Tue, 06 Dec 2022 19:03:39 GMT

Are the requirements for Unity Catalog fulfilled? UC is available for "Premium plan or above" only and the account admin has to enable it.

Re: Is catalog a feature in the community version?

blobbles — Wed, 01 Mar 2023 22:59:10 GMT

I changed to 11.2 now in datafactory, that also worked

topic Re: Is catalog a feature in the community version? in Data Engineering

Is catalog a feature in the community version?

Re: Is catalog a feature in the community version?

Re: Is catalog a feature in the community version?

Re: Is catalog a feature in the community version?

Re: Is catalog a feature in the community version?

Re: Is catalog a feature in the community version?