topic Re: Does Databricks SQL support Azure SQL DB? in Warehousing & Analytics

Does Databricks SQL support Azure SQL DB?

mehdi1 — Thu, 20 Mar 2025 17:01:50 GMT

Hi,

I could create spark tables based on SQL server (Azure SQL actually), and query the tables from a notebook.

On another hand, I can see the tables listed in the hive metastore in Databricks SQL. However when I try to query the tables there, it says only CSV, json, parquet, etc. (meaning file based) tables are supported.

Is there anyway to overcome that ? It looks pretty inconsistent to me that we can query the tables in Data Science and Engineering mode but not in SQL mode.

Re: Does Databricks SQL support Azure SQL DB?

Prabakar — Wed, 08 Jun 2022 00:30:48 GMT

@Mehdi Aziz Boumedine

When you query Hive tables on Databricks SQL, you get an error "Reading Hive table <table-name> is not supported on Databricks SQL. Only csv, json, avro, delta, parquet, orc, text, unity_catalog data sources are supported". This is because Hive based tables are not supported on Databricks SQL

The solution is to add few records/overwrite records either in parquet/orc or any desired format. Adding rows in parquet for instance will change the relation from "HiveTableRelation" to Parquet relation, which makes the table queryable in Databricks SQL

Re: Does Databricks SQL support Azure SQL DB?

Anonymous — Mon, 20 Jun 2022 17:36:27 GMT

Hey @Mehdi Aziz Boumedine

Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.

Cheers!

Re: Does Databricks SQL support Azure SQL DB?

saltuk — Tue, 21 Jun 2022 11:35:20 GMT

@Kaniz Fatma @Prabakar Ammeappin

I do not know if you aware of what @bhumi shamra published above?

this comments are irrelevant ..

Re: Does Databricks SQL support Azure SQL DB?

saltuk — Tue, 21 Jun 2022 11:49:28 GMT

@Kaniz Fatma

no problem at all, but user has done that in a multiple tickets.

please see:

https://community.databricks.com/s/question/0D58Y00008mqagOSAQ/how-do-i-install-a-non-pythonrmavenjar-library-into-a-cluster

Re: Does Databricks SQL support Azure SQL DB?

saltuk — Tue, 21 Jun 2022 12:17:22 GMT

No problem at all. 🙂

Re: Does Databricks SQL support Azure SQL DB?

saltuk — Tue, 21 Jun 2022 12:19:53 GMT

@Kaniz Fatma

May I request, could you please guide me on my ticket? maybe you can help me out here , recently i have been working on it but i am stuck:

https://community.databricks.com/s/question/0D58Y00008qXvbNSAS/databricks-sql-cannot-communicate-with-external-hive-metastore-which-runs-on-postgre-sql

Re: Does Databricks SQL support Azure SQL DB?

jose_gonzalez — Fri, 29 Jul 2022 00:29:33 GMT

Hi @saltuk bozok,

Just a friendly follow-up. Do you still need help or you were able to find a solution? please let us know