topic Re: While mounting Azure Data Lake Storage Account to Azure Databricks, I am facing issue. How to fix this? in Data Engineering

While mounting Azure Data Lake Storage Account to Azure Databricks, I am facing issue. How to fix this?

Akanksha533 — Sat, 07 Jan 2023 01:22:34 GMT

Re: While mounting Azure Data Lake Storage Account to Azure Databricks, I am facing issue. How to fix this?

BigMF — Sat, 07 Jan 2023 03:31:25 GMT

Do you have the "configs" defined to include the appropriate credentials? Per the Microsoft documentation, their example shows:

configs = {"fs.azure.account.auth.type": "OAuth",
          "fs.azure.account.oauth.provider.type": "org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider",
          "fs.azure.account.oauth2.client.id": "<application-id>",
          "fs.azure.account.oauth2.client.secret": dbutils.secrets.get(scope="<scope-name>",key="<service-credential-key-name>"),
          "fs.azure.account.oauth2.client.endpoint": "https://login.microsoftonline.com/<directory-id>/oauth2/token"}
 
# Optionally, you can add <directory-name> to the source URI of your mount point.
dbutils.fs.mount(
  source = "abfss://<container-name>@<storage-account-name>.dfs.core.windows.net/",
  mount_point = "/mnt/<mount-name>",
  extra_configs = configs)

Re: While mounting Azure Data Lake Storage Account to Azure Databricks, I am facing issue. How to fix this?

Hubert-Dudek — Sat, 07 Jan 2023 12:14:35 GMT

Please mount ADLS storage as described here:

https://community.databricks.com/s/feed/0D53f00001eQGOHCA4

Re: While mounting Azure Data Lake Storage Account to Azure Databricks, I am facing issue. How to fix this?

Aviral-Bhardwaj — Sat, 07 Jan 2023 16:02:13 GMT

thanks for this details issue it will help other users