topic Re: bundle run fails with [UC_NOT_ENABLED] in Data Engineering

bundle run fails with [UC_NOT_ENABLED]

T0M — Mon, 21 Oct 2024 13:52:37 GMT

Hi all,

I am trying to run my first databricks asset bundle but it always fails with

[UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster. SQLSTATE: 56038

Does anyone ecountered this error when running asset bundles or does anyone know how to fix it?

the yml goes like

bundle: name: hello_world workspace: host: https://... variables: spark_version: description: "The version of Spark to use." default: 15.4.x-scala2.12 resources: jobs: some-task: name: "[${bundle.target}] some_task" tasks: - task_key: task_loop for_each_task: inputs: "[{\"par1\": \"hello\", \"par2\": \"world\"}, {\"par1\": \"spam\", \"par2\": \"eggs\"}]" task: task_key: some_task_key job_cluster_key: job-cluster notebook_task: notebook_path: notebooks/nb base_parameters: { "par1": "{{input.par1}}", "par2": "{{input.par2}}" } job_clusters: - job_cluster_key: job-cluster new_cluster: spark_version: ${var.spark_version} num_workers: 1 node_type_id: e2-highmem-2 spark_conf: "spark.databricks.catalog.enabled": "true" targets: dev: mode: development default: true

running the bundle with

databricks bundle run -t dev some_task_key

Any help appreciated.

Re: bundle run fails with [UC_NOT_ENABLED]

szymon_dybczak — Mon, 21 Oct 2024 14:04:54 GMT

Hi @T0M ,

Do you have Unity Catalog enabled workspace? The error indicates that you're trying to use DAB on workspace without UC enabled.

Re: bundle run fails with [UC_NOT_ENABLED]

T0M — Mon, 21 Oct 2024 14:52:23 GMT

Hi @szymon_dybczak , thanks for your reply 🙂

I assume so, because I am using the Unity Catalog within this workspace in notebooks and workflows (writing/reading delta tables etc.) and `SELECT current_metastore();` [source] gives me a positive return (when running in a random notebook within this workspace).

That's the reason I am so confused and seeking help here.

But unfortunatly I am not the admin, therefore no access to the account console.

Re: bundle run fails with [UC_NOT_ENABLED]

filipniziol — Mon, 21 Oct 2024 15:01:47 GMT

Hi @T0M ,

Could you add this line to your job cluster definition:

            data_security_mode: SINGLE_USER

I believe it is not about workspace configuration, but about cluster configuration.

As per documentation:

Re: bundle run fails with [UC_NOT_ENABLED]

T0M — Tue, 22 Oct 2024 06:33:12 GMT

Many Thanks @filipniziol ! That solved my problem 😊

Re: bundle run fails with [UC_NOT_ENABLED]

filipniziol — Tue, 22 Oct 2024 07:24:26 GMT

Perfect! 🙂