topic Re: How to Configure a Policy in Job Cluster Using Databricks Linked Service in ADF? in Data Engineering

How to Configure a Policy in Job Cluster Using Databricks Linked Service in ADF?

ozaaditya — Mon, 17 Mar 2025 11:09:15 GMT

I am trying to configure a policy in a job cluster using Databricks Linked Service in Azure Data Factory (ADF). The goal is to restrict access to a specific group or individuals who can use this cluster.

I want to know:

How to define and enforce a cluster policy when creating a job cluster via ADF?
How to specify the allowed users or groups within the policy?

Re: How to Configure a Policy in Job Cluster Using Databricks Linked Service in ADF?

cgrant — Tue, 18 Mar 2025 21:41:21 GMT

In the Linked Services panel in the Azure Data Factory UI, find your Databricks Linked Service and click the squiggly braces {} to edit the service.

From here, you'll see a definition in JSON. Create a new key: properties.typeProperties.policyId and paste your Databricks cluster policy ID as the value. See this page for more details about Databricks cluster policies and access controls.