topic Re: Is there a way to tell if a created job is not compliant against configured cluster policies before it runs? in Data Engineering

Is there a way to tell if a created job is not compliant against configured cluster policies before it runs?

successhawk — Mon, 12 Dec 2022 04:31:06 GMT

As a DevOps engineer, I want to enforce cluster policies at deployment time when the job is deployed/created, well before it is time to actually use it (i.e. before its scheduled/triggered run time without actually running it).

Re: Is there a way to tell if a created job is not compliant against configured cluster policies before it runs?

irfanaziz — Mon, 12 Dec 2022 08:56:16 GMT

Is it not the linked service that defines the kind of cluster created or used for any job?

So i believe you could control the configuration via the linked service settings.

Re: Is there a way to tell if a created job is not compliant against configured cluster policies before it runs?

successhawk — Mon, 12 Dec 2022 19:04:19 GMT

Can you expand upon your answer? Are you talking about Azure Data Factory Linked Service?

Re: Is there a way to tell if a created job is not compliant against configured cluster policies before it runs?

irfanaziz — Mon, 12 Dec 2022 19:11:06 GMT

yes.