Debayan
Databricks Employee
Databricks Employee

Hi,

If we go by the error , 

Invalid configuration value detected for fs.azure.account.key

Storage account access key to access data using the abfssprotocol cannot be used. Please refer this https://learn.microsoft.com/en-us/azure/databricks/storage/azure-storage#access-adls-gen2-directly
In the above documentation the parameters are mentioned. 
Please tag @Debayan  with your next comment which will notify me. Thanks!