How to update table location with wasb to abfss
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-16-2023 03:00 AM
I created a table including location such as:
wasb://<container>@<storageaccount>.blob.core.windows.net/foldername
We have updated access to storage accounts to use abfss
I am trying to execute the following command:
alter table mydatabase.mytable
set location ' abfss://<container>@<storageaccount>.dfs.core.windows.net/foldername
I am getting the error:
Failure to initialize configuration for storage account <storageaccount>.dfs.core.windows.net: Invalid configuration value detected for fs.azure.account.keyInvalid configuration value detected for fs.azure.account.key
On the cluster I have changed:
spark.hadoop.fs.azure.account.key.<storageaccount>.blob.core.windows.net {{secrets/<proyect>/<storageaccount>}}
to this:
spark.hadoop.fs.azure.account.key.<storageaccount>.dfs.core.windows.net {{secrets/<proyect>/<storageaccount>}}