@alex chooi​ :

The error message suggests that there is an authentication issue when accessing the Azure storage account where the data is stored.

To resolve this issue, you can try the following steps:

1. Check if the storage account key is correctly configured in your Databricks cluster. You can find the storage account key by going to the Azure portal, selecting the storage account, and then navigating to "Access keys" under "Settings". Make sure that you have copied the correct storage account name and key to the corresponding variables in your Databricks notebook.
2. If you have recently regenerated the storage account key, make sure that you have updated the key in your Databricks notebook.
3. Check if the storage account has the necessary permissions to allow access from your Databricks cluster. You can check this by going to the Azure portal, selecting the storage account, and then navigating to "Firewalls and virtual networks" under "Security + networking". Make sure that the IP address of your Databricks cluster is added to the allowed IP addresses.
4. If the above steps do not resolve the issue, you can try re-creating the storage account and re-uploading the data to it. Sometimes, there can be issues with the storage account that cause authentication errors.