Hi,
I'm using Azure databricks service and having trouble blocking public access to my workspace.
The security groups that are attached to the subnets that databrics is using are being ignored.
From what I've learned in the last couple of days, the databricks control plane doesn't run in my vnet and subnets but in Microsoft backbone network. I've tried solve that out using a firewall but couldn't make it work and it is an ugly approach. I've asked in Azure community forum and got a procedure to follow which hadn't worked as well. The procedure was to create a NIC with a public IP and attach it to the subnet. Then. create a route table which consists of a route rule from the control plane to the NIC public IP but this hadn't worked as well.
Any guidence here would be appreciated
Thanks
Gil