job event trigger - Invalid credentials for storage location

[AsphaltDataRide]

I want to use an event trigger to start a job.

-The MI has the Storage Blob Data Contributor role

-Test connection is successful at the level of the external location-I have read permission on the external location

-I have owner permission on the job

-On the storage account: the access connector is added as resource instance to allow access.

But at the job level I get this error:

Invalid credentials for storage location abfss://***@***.dfs.core.windows.net/. The credentials for the external location in the Unity Catalog cannot be used to read the files from the configured path. Please grant the required permissions.

Any steps I missed in configuring this?

[Anonymous]

@Asphalt DR​ :

It seems like the credentials you provided for the external location in the Unity Catalog are not sufficient to read the files from the configured path. Here are some steps you can take to resolve the issue:

1. Double-check that the MI has the correct permissions. Ensure that the MI has the necessary permissions to access the external location, including read access to the files in the configured path.
2. Verify that the external location is correctly configured in the Unity Catalog. Make sure that the credentials provided in the Unity Catalog are correct and up-to-date.
3. Check if there are any firewall or network settings that could be preventing access to the external location. Ensure that the network settings are properly configured to allow access to the external location.
4. Verify that the access connector is properly configured in the storage account. Ensure that the access connector has the necessary permissions to access the external location.

[AsphaltDataRide]

thanks @Suteja Kanuri​ , sorry for the late reply.

1. Double-check that the MI has the correct permissions. Ensure that the MI has the necessary permissions to access the external location, including read access to the files in the configured path. It has the right permissions. Otherwise the test connection would not work right?
2. Verify that the external location is correctly configured in the Unity Catalog. Make sure that the credentials provided in the Unity Catalog are correct and up-to-date. It has the right configuration. Otherwise the test connection would not work I assume?
3. Check if there are any firewall or network settings that could be preventing access to the external location. Ensure that the network settings are properly configured to allow access to the external location. Firewall should not be a problem. On top of this I added:
4. Verify that the access connector is properly configured in the storage account. Ensure that the access connector has the necessary permissions to access the external location.

Are there any other debugging options?

[Anonymous]

@Asphalt DR​ : Let me provide you more!

1. Check the job logs: The job logs may contain additional information about the error. You can access the job logs by going to the job page in the Azure portal and clicking on "Logs" in the left-hand menu. Look for any error messages that may provide additional context.
2. Test the credentials using Azure Storage Explorer: You can use Azure Storage Explorer to test the credentials you are using to access the external storage location. If the credentials work with Storage Explorer, then there may be an issue with the configuration of the event trigger or job.
3. Check if the account key has been regenerated: If you have recently regenerated the account key for the storage account, ensure that the new key is being used in the job and event trigger configuration.
4. Check if the storage account is in a different region than the job and event trigger: If the storage account is in a different region than the job and event trigger, there may be a delay in syncing the permissions. Wait for a few minutes and try again.
5. Verify the event trigger configuration: Ensure that the event trigger is configured correctly, with the correct storage account and path specified. Check that the trigger is enabled and that it is set to the correct event type.
6. Check if the file system is correctly configured: If the external storage location is an ADLS Gen2 file system, ensure that it is correctly configured. Check that the file system is not in a deleted state, and that the file system permissions are correctly set.

[Priyag1]

Goor guidance