topic Re: Problems connecting Simba ODBC with a M1 Macbook Pro in Data Engineering

Problems connecting Simba ODBC with a M1 Macbook Pro

Nico1 — Sun, 15 May 2022 21:58:10 GMT

Hi,

There's a way to make work the Simba ODBC Driver for M1 Macbook Pros?

I find myself able to run on an old intel version of Macbook easily, but now every time I even test the connection with the iODBC Manager fails.

Definitely, the issue is around not being built for ARM, did anyone find a solution or there's going to be shortly a release with ARM support?

Thanks in advance!

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

Atanu — Thu, 26 May 2022 09:19:02 GMT

Hello @Nicolino Oppes Currently we don't have the odbc for M1 chip and our engineering team is working on this. May be end of Q3 we can expect the release.

We apologize for the inconvenience caused.

Thanks.

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

Yati — Tue, 06 Sep 2022 18:49:11 GMT

Hey @Atanu Sarkar

Since we are near the end of Q3, are we expecting a release of ODBC server for M1?

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

MengdanLiu_ — Thu, 29 Sep 2022 02:48:23 GMT

Hi @Atanu Sarkar , hope you are doing well. May I know if the release of ODBC for M1 chip will be released or not? Thank you.

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

Nico1 — Tue, 04 Oct 2022 16:07:37 GMT

Hi Databricks Team and @Atanu Sarkar ,

Could I please kindly have an update on the Driver status? There's a deadline in place?

Thanks in advance.

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

Atanu — Tue, 04 Oct 2022 16:19:02 GMT

@Nicolino Oppes @Yatindra Athivarapu @Mengdan Liu

ODBC doesn’t officially support ARM (M1) architecture. So that’s probably the root cause.However unofficially M1 rosetta emulation is capable of emulating ODBC Intel instruction on M1 and we have many scenarios that ODBC on M1 worked out of the box (Tableau with ODBC on M1 works through rosetta, etc).for short term workarounds:

either you can try using anything other than M1 if you have other VMs, machines.
the other option is you should play with rosetta emulation on M1 to see if there is a way to make this work (check here) this is unknown territory.
it seems this error is coming from excel not ODBC. so maybe you can search if for excel on mac there is any way to disable that additional validation which is failing

long term simba will officially add support for M1 to ODBC (that’s in their backlog, probably will be ready sometime in Q4 or so).

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

kunalmishra9 — Thu, 24 Aug 2023 08:15:07 GMT

Wanted to follow up here as well!

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

Atanu — Thu, 24 Aug 2023 14:24:47 GMT

@MengdanLiu_ I see from internal note customer is using odbc for M1 . so it's supported now.

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

kunalmishra9 — Fri, 25 Aug 2023 05:23:12 GMT

I'm ~99% sure that ARM (and Apple Silicon Macs, by extension), are not yet supported. Went down many rabbit holes to attempt configuration of the Databricks ODBC driver and wasn't able to get it up and running.

The evidence suggesting a lack of support:

The release notes of the Databricks Spark SQL drivers make no mention of it
Similarly, the release notes indicate a new version hasn't been released since 2022-07-12, which predates the first reply to OP.
In my Terminal, the command `file /Library/simba/spark/lib/libsparkodbc_sbu.dylib` shows compilation for `i386` and `x86_64`, but not `arm64e`.
During my rabbit hole exploration to set up ODBC, I stumbled across blogs like this one, indicating the issue still exists and requires a rather massive lift to solve for when using with R & RStudio.

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

Atanu — Mon, 28 Aug 2023 14:01:09 GMT

I have installed to my M1 chip Mac on Friday,.

I will be doing a couple of testing. and share the update.

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

kunalmishra9 — Wed, 27 Sep 2023 08:12:39 GMT

Have good news to report on this end:

- A new version of the ODBC driver was released on 2023-09-08 (I spoke with a Databricks engineer the day prior about this)

- The latest version of the driver is indeed compiled for arm64 and supports Apple Silicon natively

- Still working to get things set up but there was at least progress on this

Re: Problems connecting Simba ODBC with a M1 Macbook Pro

kunalmishra9 — Wed, 27 Sep 2023 21:24:53 GMT

Things seem to be mostly working for me now. I've added a bit more detail on my connection steps and process in case it's helpful for anyone on Stack Overflow: https://stackoverflow.com/questions/76407426/connecting-rstudio-desktop-to-databricks-community-edition-on-mac-os-ventura13/77190966#77190966