I am trying to create an external table using csv file which is stored in ADLS gen2
My account owner has created a storage credential and an external location
I am a databricks user who all privileges on external location when trying to create a table using the query:
create table final_dataset_inc2 using csv
options ('path' 'abfss://container@storageaccountname.dfs.core.windows.net/data/dataset_inc2/*.csv',
'header' 'true',
'delimeter' '|',
'inferSchema' 'true')
I am getting this error:
Failure to initialize configuration for storage account storageaccountname.dfs.core.windows.net: Invalid configuration value detected for fs.azure.account.key
While when creating a delta table through UI in the data tab of databricks I am able to create a managed delta table.
But I dont need a delta table.
Now I am using a SQL warehouse cluster so I cannot even set spark configurations to overcome this error that is mentioned in the documentation.
How to overcome the error and create the table?
Does this has something to do with storage credential not having enough permission?
