โ05-09-2022 10:44 AM
Hi,
I could create spark tables based on SQL server (Azure SQL actually), and query the tables from a notebook.
On another hand, I can see the tables listed in the hive metastore in Databricks SQL. However when I try to query the tables there, it says only CSV, json, parquet, etc. (meaning file based) tables are supported.
Is there anyway to overcome that ? It looks pretty inconsistent to me that we can query the tables in Data Science and Engineering mode but not in SQL mode.
โ05-19-2022 03:05 AM
Hi @Mehdi Aziz Boumedineโ , For Databricks SQL, see SQL reference for Databricks SQL.
โ06-07-2022 05:30 PM
@Mehdi Aziz Boumedineโ
When you query Hive tables on Databricks SQL, you get an error "Reading Hive table <table-name> is not supported on Databricks SQL. Only csv, json, avro, delta, parquet, orc, text, unity_catalog data sources are supported". This is because Hive based tables are not supported on Databricks SQL
The solution is to add few records/overwrite records either in parquet/orc or any desired format. Adding rows in parquet for instance will change the relation from "HiveTableRelation" to Parquet relation, which makes the table queryable in Databricks SQL
โ06-20-2022 10:36 AM
Hey @Mehdi Aziz Boumedineโ
Hope you are well. Just wanted to see if you were able to find an answer to your question and would you like to mark an answer as best? It would be really helpful for the other members too.
Cheers!
โ06-21-2022 04:35 AM
@Kaniz Fatmaโ @Prabakar Ammeappinโ
I do not know if you aware of what @bhumi shamraโ published above?
this comments are irrelevant ..
โ06-21-2022 04:43 AM
Hi @saltuk bozokโ, Thanks for flagging!
โ06-21-2022 04:49 AM
@Kaniz Fatmaโ
no problem at all, but user has done that in a multiple tickets.
please see:
โ06-21-2022 05:08 AM
Thank you so much for flagging this to us. It will be taken care of. So grateful to have customers like you ๐ .
โ06-21-2022 05:17 AM
No problem at all. ๐
โ06-21-2022 05:19 AM
@Kaniz Fatmaโ
May I request, could you please guide me on my ticket? maybe you can help me out here , recently i have been working on it but i am stuck:
โ06-21-2022 06:00 AM
Sure, Let me check.
โ07-28-2022 05:29 PM
Hi @saltuk bozokโ,
Just a friendly follow-up. Do you still need help or you were able to find a solution? please let us know
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group