โ09-10-2021 04:33 PM
Hi,
is there any way/workaround to query JDBC tables the same way one can do with other type of clusters?
Doing so right now causes an error saying that only text based files are supported (json, parquet, delta etc) even though the tables are recognized in the sql workspace.
โ09-11-2021 11:24 AM
Hello @E Hโ!
My name is Piper and I'm one of the community moderators. I wanted to pop in and thank you for your question. I'm sure that a fellow community member will be by to answer your question shortly. If not, the team will be back on Monday.
Cheers!
โ09-13-2021 05:50 AM
To my understanding SQL Endpoint is connected to your hive metastore. One possible way is to connect your metastore to the corresponding JDBC table so that metadata is available for SQL endpoint to connect.
โ09-13-2021 10:13 AM
Hi Sebastian, thank you for your answer.
You are right, SQL endpoint uses the same metastore as the other clusters. Therefore, after creating a JDBC table in a high currency cluster, I do see the table in the sql analytics workspace. The table is recognized and the schema is even visible. However, when querying the table , an error occurs explaining than JDBC is not supported, only text based file are. The same query works correctly when using the high currency cluster.
โ09-17-2021 08:11 AM
@E Hโ can you share a screenshot of the error in Databricks SQL? And also a screenshot of the query working in the Data science & engineering workspace?
โ09-18-2021 06:15 AM
โ09-20-2021 01:35 PM
โ09-21-2021 03:36 AM
@E Hโ I thought I replied, but apparently I didn't -- apologies for the late response. So there are two different things in play:
What actual engine are you connecting to with the JDBC data source? Is it MySQL, Postgres etc?
โ11-10-2021 09:06 AM
Being able to join data coming both from the delta lake and Azure SQL would be an excellent feature for SQL Analytics - providing us the option to supply the reporting community (Power BI) with a single data hub.
โ09-21-2021 05:08 AM
Thanks for the clarifications @Bilal Aslamโ .
The query above was executed on an Azure sql managed instance datasource.
Thanks,
Eric
โ12-22-2021 06:40 AM
Any news regarding this feature?
โ12-28-2021 07:23 AM
@E Hโ nope, not yet. It's definitely on our list of things to figure out and support.
โ12-23-2021 07:04 AM
+1
It would be great to have this option. I'm on the way to building a Data Analytics Platform based on Databricks SQL for my customer. Databricks SQL is really cool product, but it seems it doesn't support reading data from PostgreSQL (Azure DBaaS). For me, it just shows a shema and that's all. Works well in the Data Engineering workspace. Please consider this feature.
โ02-23-2022 09:21 AM
I've been waiting patiently for this option since public preview early 2021. The vast majority of our data is in SQL Server databases, and because we are unable to query these data sources is the primary reason the data team hasn't adopted SQL Workspace as a solution. We support JDBC connectivity, and it is nice that the metastore works, but without being able to query the data is in my opinion oversight.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group