Problem activating File Events for External Location / ADLS V2

[Dimitry]

Hi all

I've followed the book for creating external location for Azure Data Lake Storage (ADLS V2) using account connector

I've granted all required permissions to the connector:

I've created a "stock" container on that above mentioned "devtyremeshare" storage account:

and configured as recommended:

I can read files no prob

BUT I can't get file events to work.

It reports missing permission to write into the storage account, even after I created a custom role with 'Microsoft.Storage/storageAccounts/write' permission on the subscription level and assigned to the app connector (which is 4d2fd0d9-2339-498a-b058-990c13b55cf9 below)

I've been double checking and couldn't find any difference with the Microsoft learn guides.

No educational videos on youtube touches a subject of file triggers.  

Note that I also tried to create a POC job to hook on the file events and it errored exactly the same way.

Please help!!!

[Khaja_Zaffer]

Translator

Hello Dimitry,

checking on this. 

[Khaja_Zaffer]

Hello @Dimitry 
Can you please check two things for me. 

1. Register the Event Grid Resource Provider: to check this go to subscription > Settings >Resource providers>event grid is registered or not?

2. 403 error is more of no connection actually, its strange that you are able to read the file. 

For this. can you confirm on the Firewalls and virtual networks of storage account. check whether you have. checked : Enabled from selected virtual networks and IP addresses

these are my findings. I hope others have any solution for this issue. 

[Dimitry]

Thanks a lot for trying to help

Yes, Event Grid was not registered.

Unfortunately the error remains the same.

I got a very simple setup with Databricks having a public IP, storage account also public.

I don't get why it is not working as expected when everything is plain and simple.

[Khaja_Zaffer]

Mostly I think there are some policies set by your company on this. 

[Khaja_Zaffer]

I am 1000% sure that your evengrid is not registered. 

[Khaja_Zaffer]

I dont know how can we connect on teams to resolve the issue. is it possible? I am not working for msft or databricks currently. so asking you to join for a call is against the community guidance? I am not sure of this. 

[Dimitry]

your responds come around 2AM my time zone, I feel we are on the opposite sides of earth. I'm in Sydney, AUS

[Khaja_Zaffer]

can we connect through linkedin, lets do it Dimitry. 

[Khaja_Zaffer]

Also if you require we can setup a call through teams, I can share teams meeting link 

[Dimitry]

I'm online. Drop the link

[Khaja_Zaffer]

Hello @Dimitry 

No subject | Meeting-Join | Microsoft Teams
8:30 AM UK TIME which is 17:30 Sydney time. 
( i woke up just now)

[Dimitry]

Thanks! Meet u soon

[Khaja_Zaffer]

Hello @Dimitry 
IT was great meeting you. 

please raise the ticket using this lik  https://help.databricks.com/s/contact-us?ReqType=training Please explain the issue clearly so that it will be easy for supoort team to help easily. Also raise a ticket with azure databricks team.

Apolgies that I couldnt help you further, however may be somone else can help on this?