topic Re: Unable to connect/read files from ADLS Gen2 using account key in Data Engineering

Unable to connect/read files from ADLS Gen2 using account key

farooqurrehman — Mon, 23 Jan 2023 16:59:17 GMT

It gives error

[RequestId=5e57b66f-b69f-4e8b-8706-3fe5baeb77a0 ErrorClass=METASTORE_DOES_NOT_EXIST] No metastore assigned for the current workspace.

using the following code

spark.conf.set(

"fs.azure.account.key.mystorageaccount.dfs.core.windows.net",

dbutils.secrets.get(scope="keyvault-secret-scope2", key="ADLS-GEN2-SECRET-KEY"))

dbutils.fs.ls("abfss://containername@mystorageaccount.dfs.core.windows.net/")

mystorageaccount: ADLS Gen2 account name

containername: Container name

scope="keyvault-secret-scope2" : scope created in Azure Databricks with Manage "All users"

key="ADLS-GEN2-SECRET-KEY" : secret in Azure key vault, having the ADLS Gen2 access key

Re: Unable to connect/read files from ADLS Gen2 using account key

Hubert-Dudek — Mon, 23 Jan 2023 19:03:45 GMT

Is it a unity catalog workspace?

These pages can also help:

https://community.databricks.com/s/feed/0D53f00001eQGOHCA4

https://community.databricks.com/s/feed/0D58Y00009hlj04SAA

Re: Unable to connect/read files from ADLS Gen2 using account key

Vivian_Wilfred — Mon, 23 Jan 2023 19:46:50 GMT

Hi @Farooq ur rehman ,

What's the Cluster security access mode? In the JSON of the cluster, the data_security_mode has to be set to LEGACY_SINGLE_USER. If this is set to SINGLE_USER, the cluster will look for a Unity Catalog metastore.

Re: Unable to connect/read files from ADLS Gen2 using account key

jose_gonzalez — Fri, 24 Feb 2023 23:36:46 GMT

Hi @Farooq ur rehman,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.