topic Re: Unity catalog with pool cluster in Data Engineering

Unity catalog with pool cluster

Jothia — Thu, 03 Jul 2025 14:02:04 GMT

We are trying to execute notebook recently migrated to unity catalog through Pool cluster from synapse pipeline. But it giving error as "UC not enabled".Could you please suggest on this.

Re: Unity catalog with pool cluster

nayan_wylde — Thu, 03 Jul 2025 14:08:28 GMT

Can you please share the cluster config and access mode of cluster

Re: Unity catalog with pool cluster

Jothia — Thu, 03 Jul 2025 14:27:13 GMT

Created pool cluster with version Driver: Standard_D4ds_v5 · Workers: Standard_D4ds_v5 · 1 worker · from pool · DBR: 14.3 LTS (includes Apache Spark 3.5.0, Scala 2.12)

Re: Unity catalog with pool cluster

Jothia — Thu, 03 Jul 2025 14:29:01 GMT

Access mode option not available to create under pool

Re: Unity catalog with pool cluster

szymon_dybczak — Thu, 03 Jul 2025 14:56:25 GMT

Hi @Jothia ,

So you created your pool as I did on the screenshot below.

Now, you need to go to the compute and create cluster based on that pool. So you need to click on Compute button.

And then you need to create new compute based on your pool. Pay attention that compute that you choose should be compatible with Unity Catalog (Data access)

And last thing, on advance tab you have an option to choose access mode for your compute:

Re: Unity catalog with pool cluster

nayan_wylde — Thu, 03 Jul 2025 14:59:09 GMT

Agree in access mode is not available but when you create the cluster select access mode as dedicated or standard to access UC objects.

Re: Unity catalog with pool cluster

Jothia — Thu, 03 Jul 2025 15:32:12 GMT

@szymon_dybczak My issue is not with triggering notebooks from synapse with pool cluster because that time pool creates job cluster is getting creating automatically without access mode. How to rectify that

Re: Unity catalog with pool cluster

nayan_wylde — Thu, 03 Jul 2025 16:04:30 GMT

@Jothia I got your issue. I think your job clusters are creating in custom mode by default. Change this parameter in settings-->security. It will create a UC enabled cluster by default whenever a job cluster is created.

You need to be workspace admin to change this property. Hope it resolves your issue.

Re: Unity catalog with pool cluster

Jothia — Fri, 04 Jul 2025 12:35:43 GMT

@nayan_wylde Thanks your suggestion. It worked for us.. Thanks a lot for your help