How to update table location with wasb to abfss

lazcanja — Wed, 16 Aug 2023 10:00:42 GMT

I created a table including location such as:

wasb://<container>@<storageaccount>.blob.core.windows.net/foldername

We have updated access to storage accounts to use abfss

I am trying to execute the following command:

alter table mydatabase.mytable
set location ' abfss://<container>@<storageaccount>.dfs.core.windows.net/foldername

I am getting the error:

Failure to initialize configuration for storage account <storageaccount>.dfs.core.windows.net: Invalid configuration value detected for fs.azure.account.keyInvalid configuration value detected for fs.azure.account.key

On the cluster I have changed:

spark.hadoop.fs.azure.account.key.<storageaccount>.blob.core.windows.net {{secrets/<proyect>/<storageaccount>}}

to this:

spark.hadoop.fs.azure.account.key.<storageaccount>.dfs.core.windows.net {{secrets/<proyect>/<storageaccount>}}

topic How to update table location with wasb to abfss in Data Engineering

How to update table location with wasb to abfss