Streamsets to Databricks Integration failure
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
3 weeks ago
Hi Team,
While trying to ingest data from ADLS gen 2 to Databricks through Streamsets. I am getting below error
Configuration fs.azure.account.key.xxx.dfs.core.windows.net is not available.
Able to make connection from Streamsets to databricks using sql warehouse JDBC connection.
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
3 weeks ago
Hello @Subbu_G,
Ensure that the Spark configuration for the ADLS Gen 2 account key is correctly set. The configuration should follow the format:
spark.hadoop.fs.azure.account.key.<storage-account-name>.dfs.core.windows.net <your-storage-account-key>

