Hi there!
Hope somebody here can help me. We have created a new Databricks Account on Azure with the ARM template for VNET injection.
We have all the subnets etc., unitiy catalog active and the connector for databricks.
I want now to create my first table linked to a azure datalake gen2 stroage account. The external location is created sucessfully and connection test is valid. I can also browse the storage and see the parquet file that I want to create a Delta-Table from. But if I select the file and click on "preview table" I get the error:
Fail to get table preview. Your request failed with status: [BAD_Request] This Azure storage request is not authorized. The storage account's 'Firewalls and virtual networks' settings may be blocking access to storage services. Please verify your Azure storage credentials or firewall exception settings.
The Databricks Connector is also set as Storage contributor in the ADLS.
I also tested it with a ADLGen2 with public availability, that working fine. I would expect, if the Databricks Workspace / Connector don't habe access to the Storage, I should also not be able to browse it.
Did anybody have an Idea what I maybe have forgot?
Thanks!