How to parameterize key of spark config in the job clusterlinked service from ADF

[KVNARK]

how can we parameterize key of the spark-config in the job cluster linked service from Azure datafactory, we can parameterize the values but any idea how can we parameterize the key so that when deploying to further environment it takes the PROD/QA values. Thanks much in advance!!!

[daniel_sahal · Accepted solution]

@KVNARK .​ 

You can use Databricks Secrets (create a Secret scope from AKV https://learn.microsoft.com/en-us/azure/databricks/security/secrets/secret-scopes) and then reference a secret in spark configuration (https://learn.microsoft.com/en-us/azure/databricks/security/secrets/secrets)

[KVNARK]

Thanks a lot. This helps @Daniel Sahal​ 

[KVNARK]

@Daniel Sahal​ - what ever the links you share for any requirement is really very much helpful. Kudos...

[daniel_sahal]

@KVNARK .​ Thanks! I'm always happy to help 🙂