Database creation error

[Arpi]

I am trying to create database with external location abfss but facing the below error.

AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Got exception: shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.contracts.exceptions.KeyProviderException Failure to initialize configuration)

the command that I am using :

spark.sql("CREATE DATABASE IF NOT EXISTS test LOCATION 'abfss://<your-storage-account-name>@<your-storage-account-name>.dfs.core.windows.net/your/path'")

FYI, I am able to read data successfully though datalake in daatbricks

[Lakshay · Accepted solution]

Hi @Arpit Agrawal​ , This issue generally comes when you set the ADLS at notebook level. If this is the case for you, please set the config at the cluster level. This should resolve the issue.

[Anonymous]

Hi @Arpit Agrawal​ 

Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. 

We'd love to hear from you.

Thanks!

[jose_gonzalez]

Hi @Arpit Agrawal​,

Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.

[source2sea]

Changing it to a CLUSTER level for OAuth authentication helped me solve the problem.
I wish the notebook AI bot could tell me the solution.

before the changes, my configraiotn was at the notebook leve.and  it has below errors

AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: MetaException(message:Got exception: shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.contracts.exceptions.KeyProviderException Failure to initialize configuration)
Caused by: HiveException: MetaException(message:Got exception: shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.contracts.exceptions.KeyProviderException Failure to initialize configuration)
Caused by: MetaException: Got exception: shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.contracts.exceptions.KeyProviderException Failure to initialize configuration