Databricks Community

dcrezee · 12-20-2021

I'm trying to connect to Databricks using pyodbc and I'm running into an issue with struct columns. As far as I understand, struct columns and array columns are not supported by pyodbc, but they are converted to JSON. However, when there are nested c...

dcrezee · 01-03-2022

Hey Bilal,Thanks for your reply. This indeed works and is what I'm currently using as a work around (see one of the previous posts).Thanks,Derk

dcrezee · 12-23-2021

Thanks @Kaniz Fatma (Databricks) . Have tried adding above script as a startup script to the cluster configuration I'm using within databricks, but issue remains.

dcrezee · 12-22-2021

Hi @Kaniz Fatma , thanks for the reply. I think I misunderstood. So the suggestion is to install a number of package and update pyodbc on the Databricks cluster you are using? Will give it a try.

dcrezee · 12-22-2021

Hi @Kaniz Fatma ,My question wasn't related to connecting Databricks to SQL Server, but on an error I'm getting while connecting to Databricks using pyodbc.Thanks,Derk

dcrezee · 12-22-2021

Hi @Kaniz Fatma , Thanks for the reply. I'm still curious to the answer for the question above, but I did manage to find a work around.Work AroundUsing the to_json method, you can let Spark convert all the complex columns into json, instead of relyi...

Databricks Community

User Stats

User Activity

Issue with quotes in struct type columns when using ODBC

Re: Issue with quotes in struct type columns when using ODBC

Re: Issue with quotes in struct type columns when using ODBC

Re: Issue with quotes in struct type columns when using ODBC

Re: Issue with quotes in struct type columns when using ODBC

Re: Issue with quotes in struct type columns when using ODBC