topic Re: How to connect from Serverless Plane to On-Prem SQL Server in Data Engineering

How to connect from Serverless Plane to On-Prem SQL Server

shhhhhh — Fri, 17 Jan 2025 13:21:45 GMT

so has anybody tried connecting Databricks Serverless in the Serverless plane to on-prem SQL server.

we can connect databricks normal cluster with federated queries with External Data connections to on-prem SQL server
we can connect Serverless to Azure Storage Accounts using NCC and Private Links. good documentation here https://learn.microsoft.com/en-us/azure/databricks/security/network/serverless-network-security/serverless-private-link

So wanted to know how to connect serverless to on prem SQL server

many thanks

Re: How to connect from Serverless Plane to On-Prem SQL Server

Walter_C — Fri, 17 Jan 2025 15:09:35 GMT

Please allow me with some time to do some investigation internally, just to confirm no Private Link configuration is set on your workspace right?

Re: How to connect from Serverless Plane to On-Prem SQL Server

shhhhhh — Fri, 17 Jan 2025 15:31:46 GMT

oh thanks for investigating.

for the serverless --> azure storage account , I created an NCC and created Private Endpoint rules for the storage accounts, and associated the NCC with the workspace. I'm guessing this is not the Private Link config you are asking we have.

Re: How to connect from Serverless Plane to On-Prem SQL Server

shhhhhh — Mon, 20 Jan 2025 17:44:34 GMT

let me know if you need more information. this is the last piece of the jigsaw as we have successfully installed our library onto serverless and opened up storage accounts, we just need that link configuration to point to our SL server

Re: How to connect from Serverless Plane to On-Prem SQL Server

Walter_C — Mon, 20 Jan 2025 20:57:18 GMT

No, Private link is to set up your workspace with no access to the internet, have you tried allowing the NCC ips with on the on Prem firewall?

Re: How to connect from Serverless Plane to On-Prem SQL Server

shhhhhh — Sat, 25 Jan 2025 20:12:17 GMT

so sorry, not sure what you mean here. So where do I find the NCC IP's ?