https://community.databricks.com/t5/data-engineering/accessing-secret-from-spark-cluster/m-p/11056#M6097 <P>passing spark configuration to access blob, adls from data factory while creating job cluster</P><P>it's working fine, but when in the property we are accessing secret it's not working</P><P>spark.hadoop.fs.azure.account.auth.type.{{secrets/scope/key}}.<A href="http://dfs.core.windows.net" alt="http://dfs.core.windows.net" target="_blank">dfs.core.windows.net</A> value&nbsp;</P><P></P><P><A href="http://spark.hadoop.fs.azure.account.oauth2.client.id.accountname.dfs.core.windows.net" alt="http://spark.hadoop.fs.azure.account.oauth2.client.id.accountname.dfs.core.windows.net" target="_blank">spark.hadoop.fs.azure.account.oauth2.client.id.accountname.dfs.core.windows.net</A>": "{{secrets/scope/key}}"</P><P>this is working, but in the property when passing the secret it's not working. Please let me know if anyone has solution to the same.</P><P></P><P>Thanks much in advance.</P> Fri, 20 Jan 2023 06:05:39 GMT KVNARK 2023-01-20T06:05:39Z https://community.databricks.com/t5/data-engineering/accessing-secret-from-spark-cluster/m-p/11056#M6097 <P>passing spark configuration to access blob, adls from data factory while creating job cluster</P><P>it's working fine, but when in the property we are accessing secret it's not working</P><P>spark.hadoop.fs.azure.account.auth.type.{{secrets/scope/key}}.<A href="http://dfs.core.windows.net" alt="http://dfs.core.windows.net" target="_blank">dfs.core.windows.net</A> value&nbsp;</P><P></P><P><A href="http://spark.hadoop.fs.azure.account.oauth2.client.id.accountname.dfs.core.windows.net" alt="http://spark.hadoop.fs.azure.account.oauth2.client.id.accountname.dfs.core.windows.net" target="_blank">spark.hadoop.fs.azure.account.oauth2.client.id.accountname.dfs.core.windows.net</A>": "{{secrets/scope/key}}"</P><P>this is working, but in the property when passing the secret it's not working. Please let me know if anyone has solution to the same.</P><P></P><P>Thanks much in advance.</P> Fri, 20 Jan 2023 06:05:39 GMT https://community.databricks.com/t5/data-engineering/accessing-secret-from-spark-cluster/m-p/11056#M6097 KVNARK 2023-01-20T06:05:39Z https://community.databricks.com/t5/data-engineering/accessing-secret-from-spark-cluster/m-p/11057#M6098 <P>check here : <A href="https://docs.databricks.com/security/secrets/secrets.html" target="test_blank">https://docs.databricks.com/security/secrets/secrets.html</A></P> Sun, 22 Jan 2023 12:43:00 GMT https://community.databricks.com/t5/data-engineering/accessing-secret-from-spark-cluster/m-p/11057#M6098 sher 2023-01-22T12:43:00Z