Can you apply a specific cluster policy when launching a Databricks job via Azure Data Factory
When using Azure Data Factory to coordinate the launch of Databricks jobs - can you specify which cluster policy to apply to the job, either explicitly or implicitly?
- 2719 Views
- 1 replies
- 1 kudos
Latest Reply
you could, but not from ADF's UI. You need to edit the json of the linked service, adding a 'policyId' parameter in the 'typeProperties' object, pointing to the cluster policy ID from Databricks (which you could find in Databricks' URL).
- 1 kudos