bundle run fails with [UC_NOT_ENABLED]

[T0M]

Hi all,

I am trying to run my first databricks asset bundle but it always fails with 

[UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster. SQLSTATE: 56038

Does anyone ecountered this error when running asset bundles or does anyone know how to fix it?

the yml goes like

bundle:
  name: hello_world

workspace:
  host: https://...

variables: 
  spark_version:
    description: "The version of Spark to use."
    default: 15.4.x-scala2.12

resources:
  jobs:
    some-task:
      name: "[${bundle.target}] some_task"
      tasks:
        - task_key: task_loop
          for_each_task: 
            inputs: "[{\"par1\": \"hello\", \"par2\": \"world\"}, {\"par1\": \"spam\", \"par2\": \"eggs\"}]"
            task:
              task_key: some_task_key
              job_cluster_key: job-cluster
              notebook_task:
                notebook_path: notebooks/nb
                base_parameters: {
                  "par1": "{{input.par1}}",
                  "par2": "{{input.par2}}"
                }
      job_clusters:
        - job_cluster_key: job-cluster
          new_cluster:
            spark_version: ${var.spark_version}
            num_workers: 1
            node_type_id: e2-highmem-2
            spark_conf: 
              "spark.databricks.catalog.enabled": "true"

targets:
  dev:
    mode: development
    default: true

running the bundle with

databricks bundle run -t dev some_task_key

Any help appreciated.

[szymon_dybczak]

Hi @T0M ,

Do you have Unity Catalog enabled workspace? The error indicates that you're trying to use DAB on workspace without UC enabled.

[T0M]

Hi @szymon_dybczak , thanks for your reply 🙂

I assume so, because I am using the Unity Catalog within this workspace in notebooks and workflows (writing/reading delta tables etc.) and `SELECT current_metastore();` [source]  gives me a positive return (when running in a random notebook within this workspace).

That's the reason I am so confused and seeking help here.

But unfortunatly I am not the admin, therefore no access to the account console.

[filipniziol · Accepted solution]

Hi @T0M ,

Could you add this line to your job cluster definition:

            data_security_mode: SINGLE_USER

 I believe it is not about workspace configuration, but about cluster configuration.

As per documentation:

[T0M]

Many Thanks @filipniziol ! That solved my problem 😊

[filipniziol]

Perfect!  🙂