topic Re: Use SQL Server Management Studio to Connect to DataBricks? in Get Started Discussions

Use SQL Server Management Studio to Connect to DataBricks?

Shawn_Eary — Thu, 21 Sep 2023 15:31:37 GMT

The Notebook UI doesn't always provide the best experience for running exploratory SQL queries. Is there a way for me to use SQL Server Management Studio (SSMS) to connect to DataBricks?

See Also:
https://learn.microsoft.com/en-us/answers/questions/740986/how-to-connect-from-ssms-or-azure-data-studio-to-a

I know I can use Visual Studio Code and Power BI, but I want to be able to use SSMS if that's possible.
There are a few lesser-known SQL Monitor tools that use JDBC to connect to DataBricks, but for various reasons some organizations may hesitate to approve employee use of such tools

Re: Use SQL Server Management Studio to Connect to DataBricks?

-werners- — Fri, 22 Sep 2023 07:50:41 GMT

What you can do is define a SQL endpoint as a linked server. Like that you can use SSMS and T-SQL.
However, it has some drawbacks (no/bad query pushdown, no caching).
Here is an excellent blog of Kyle Hale of databricks:

Tutorial: Create a Databricks SQL Linked Server in SQL Server | by Kyle Hale | Medium

Tutorial: Create a Databricks SQL External Data Source in SQL Server with PolyBase | by Kyle Hale | SelectFrom (medium.com)

If you are in the MS ecosystem, his blog is definitely worth checking out.

Re: Use SQL Server Management Studio to Connect to DataBricks?

Shawn_Eary — Wed, 22 May 2024 18:06:07 GMT

That looks like a pretty good solution, but some organizations aren't going to give developers the permission to implement something like that.

Also, not only is it a pain to connect SQL Server Management Studio (SSMS) to Databricks, but right now, it seems to also be a pain to connect Microsoft Power Apps to Databricks. I'm not a fan of Microsoft Power Apps personally, but some organizations practically mandate use of Microsoft Power Apps.

Microsoft doesn't seem to be particularly willing to help with these incompatibility issues. I think they would rather push Fabric instead of promoting Azure Databricks.

If Databricks, Inc. isn't interested in improving compatibility with Microsoft tools, they may wind up losing customers.

Re: Use SQL Server Management Studio to Connect to DataBricks?

-werners- — Thu, 23 May 2024 07:30:18 GMT

I think MS wants to make a closed ecosystem for data. If Databricks wants to go all-in on that it would mean dropping AWS/GCP. Bad decision IMO.