ON-Prem SQL Server Direct Connection with Azure Databricks

[Upendra_Dwivedi]

Hi All,

I have SSMS installed and have some data there which i want to export to Databricks and process it there. Databricks is hosted on Azure Cloud and I am wondering if it is possible. I have tested it using JDBC connection but i am getting error: 

The TCP/IP connection to the host LAPTOP-XXXXXX, port 1433 has failed. Error: "LAPTOP-XXXXXX. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port.


I have enabled TCP/IP and also added rule in Windows Firewall to allow access but still not able to connect and getting same error. 

Please let me know if i need to set anything up before establishing connection.

Thankyou in advance.

[MariuszK]

Hi,

It's not so easy. It could work, but you would need a VNet integrated with your onpremises network where this computer is connected, configured private endpoints for Databricks and configured entries in DNS for LAPTOP-XXXXXX.

[Upendra_Dwivedi]

Hi,

I am new to this so if you have the steps to follow for source(SQL Server) and target(Databricks), it would be very helpful. Or if there is any alternative w.r.t best practices is also acceptable.

Thankyou for the reply

[MariuszK]

If you want to play with SQL Server the easy way is to use Azure SQL that will be visuable for Databricks. Alternativly you can use ADF with slef-hosted run time to extract data to Azure from SQL Server.

Network configuration requires many steps and is complex without an experience, I'm not recomending to do it.