Unity catalog with pool cluster

[Jothia]

We are trying to execute notebook recently migrated to unity catalog through Pool cluster from synapse pipeline. But it giving error as "UC not enabled".Could you please suggest on this. 

[nayan_wylde]

Can you please share the cluster config and access mode of cluster

[Jothia]

Created pool cluster with version Driver: Standard_D4ds_v5 · Workers: Standard_D4ds_v5 · 1 worker · from pool · DBR: 14.3 LTS (includes Apache Spark 3.5.0, Scala 2.12)

[Jothia]

Access mode option not available to create under pool

[szymon_dybczak]

Hi @Jothia ,

So you created your pool as I did on the screenshot below.

Now, you need to go to the compute and create cluster based on that pool. So you need to click on Compute button.

And then you need to create new compute based on your pool. Pay attention that compute that you choose should be compatible with Unity Catalog (Data access)

And last thing, on advance tab you have an option to choose access mode for your compute:

[Jothia]

@szymon_dybczak My issue is not with triggering notebooks from synapse with pool cluster because that time pool creates job cluster is getting creating automatically without access mode. How to rectify that

[nayan_wylde · Accepted solution]

@Jothia I got your issue. I think your job clusters are creating in custom mode by default. Change this parameter in settings-->security. It will create a UC enabled cluster by default whenever a job cluster is created.

You need to be workspace admin to change this property. Hope it resolves your issue.

[Jothia]

@nayan_wylde  Thanks your suggestion. It worked for us.. Thanks a lot for your help

[nayan_wylde]

Agree in access mode is not available but when you create the cluster select access mode as dedicated or standard to access UC objects.