Unable to connect/read files from ADLS Gen2 using account key

[farooqurrehman]

It gives error

[RequestId=5e57b66f-b69f-4e8b-8706-3fe5baeb77a0 ErrorClass=METASTORE_DOES_NOT_EXIST] No metastore assigned for the current workspace.

using the following code

spark.conf.set(

  "fs.azure.account.key.mystorageaccount.dfs.core.windows.net",

  dbutils.secrets.get(scope="keyvault-secret-scope2", key="ADLS-GEN2-SECRET-KEY"))

dbutils.fs.ls("abfss://containername@mystorageaccount.dfs.core.windows.net/")

mystorageaccount: ADLS Gen2 account name

containername: Container name

scope="keyvault-secret-scope2" : scope created in Azure Databricks with Manage "All users"

key="ADLS-GEN2-SECRET-KEY" : secret in Azure key vault, having the ADLS Gen2 access key

[Hubert-Dudek]

Is it a unity catalog workspace?

These pages can also help:

https://community.databricks.com/s/feed/0D53f00001eQGOHCA4

https://community.databricks.com/s/feed/0D58Y00009hlj04SAA

[Vivian_Wilfred]

Hi @Farooq ur rehman​ ,

What's the Cluster security access mode? In the JSON of the cluster, the data_security_mode has to be set to LEGACY_SINGLE_USER. If this is set to SINGLE_USER, the cluster will look for a Unity Catalog metastore.

[jose_gonzalez]

Hi @Farooq ur rehman​,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.