accessing secret from spark cluster.
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-19-2023 10:05 PM
passing spark configuration to access blob, adls from data factory while creating job cluster
it's working fine, but when in the property we are accessing secret it's not working
spark.hadoop.fs.azure.account.auth.type.{{secrets/scope/key}}.dfs.core.windows.net value
spark.hadoop.fs.azure.account.oauth2.client.id.accountname.dfs.core.windows.net": "{{secrets/scope/key}}"
this is working, but in the property when passing the secret it's not working. Please let me know if anyone has solution to the same.
Thanks much in advance.
Labels:
- Labels:
-
Key
-
Spark Cluster
-
Spark Configuration
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-22-2023 04:43 AM

