How to access storage with private endpoint

jx1226 — Mon, 27 Nov 2023 12:34:21 GMT

We know that Databricks with VNET injection (our own VNET) allows is to connect to blob storage/ ADLS Gen2 over private endpoints and peering. This is what we typically do.

We have a client who created Databricks with EnableNoPublicIP=No (secure cluster connectivity) and VnetInjection=No. So it’s using a managed VNET in the Databricks managed resource group and expose with public IP. We’re wondering if we still can make it connect to blob storage/ ADLS Gen2 over private endpoints. Or do we need to delete and recreate the Databricks workspace with VNET injection?
We want use Oauth2 with Service Principal with Storage Blob Data Contributor as role set on the blob storage/ ADLS Gen2.
We want to mount in Workspace with Service Principal credentials
In customer Workspace, UC is not activated, no possibility via UC access connector.
So basically my question is can we use this workspace setup EnableNoPublicIP=No and VnetInjection=No to access storage with private endpoint use mounting?

Re: How to access storage with private endpoint

IvoDB — Thu, 11 Apr 2024 06:59:15 GMT

Hey @jx1226 , were you able to solve this at the customer? I am currently struggling with same issues here.

topic Re: How to access storage with private endpoint in Get Started Discussions

How to access storage with private endpoint

Re: How to access storage with private endpoint