Best Practices for Managing ACLs on Jobs and Job Clusters in Databricks

shweta_m
New Contributor III

 

Hi all,

I’m setting up access control for Databricks jobs and have two questions:

  1. Ephemeral Job Clusters: Since job clusters are created at runtime, is it best practice to set ACLs on the job itself? The /api/2.0/permissions/clusters/{cluster_id} endpoint requires a cluster ID, but ephemeral clusters don’t exist beforehand.

  2. All Jobs & New Jobs: What’s the recommended way to manage ACLs for all existing jobs and automatically apply permissions to newly created jobs?

Looking for scalable, best-practice guidance.