Trying to create external table in Hive Metastore
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-04-2024 05:57 AM - edited 07-04-2024 06:17 AM
Receiving this error: KeyProviderException: Failure to initialize configuration for storage account adlspersonal.dfs.core.windows.net: Invalid configuration value detected for fs.azure.account.key
I used hive meta store to save my table
%python
spark.read.table("catalog.default.table").write.option("path", "abfss://container@storage_acc.dfs.core.windows.net/dir1").saveAsTable("annual_enterprise_survey")
But, on running:
%python
dbutils.fs.ls("abfss://container@storage_acc.dfs.core.windows.net/dir1")
Things are working perfectly. Why so?
Apart from this when trying to save tables in UC things are again working fine.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-04-2024 10:45 AM
not sure about that error, but try to do it using SQL, see if it will work
create table hive_metastore.annual_enterprise_survey as select * from catalog.defaul.table
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
07-04-2024 11:46 AM - edited 07-04-2024 11:47 AM
I tried that too but received the same error. I am trying to understand the issue here. It says Invalid configuration value detected for fs.azure.account.key. But the same is working when trying to list files.
