cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Problems connecting Simba ODBC with a M1 Macbook Pro

Nico1
New Contributor II

Hi,

There's a way to make work the Simba ODBC Driver for M1 Macbook Pros?

I find myself able to run on an old intel version of Macbook easily, but now every time I even test the connection with the iODBC Manager fails.

CleanShot 2022-05-15 at 22.50.36@2xDefinitely, the issue is around not being built for ARM, did anyone find a solution or there's going to be shortly a release with ARM support?

Thanks in advance!

1 ACCEPTED SOLUTION

Accepted Solutions

Atanu
Databricks Employee
Databricks Employee

@Nicolino Oppesโ€‹ @Yatindra Athivarapuโ€‹ @Mengdan Liuโ€‹ 

ODBC doesnโ€™t officially support ARM (M1) architecture. So thatโ€™s probably the root cause.However unofficially M1 rosetta emulation is capable of emulating ODBC Intel instruction on M1 and we have many scenarios that ODBC on M1 worked out of the box (Tableau with ODBC on M1 works through rosetta, etc).for short term workarounds:

  • either you can try using anything other than M1 if you have other VMs, machines.
  • the other option is you should play with rosetta emulation on M1 to see if there is a way to make this work (check here) this is unknown territory.
  • it seems this error is coming from excel not ODBC. so maybe you can search if for excel on mac there is any way to disable that additional validation which is failing

long term simba will officially add support for M1 to ODBC (thatโ€™s in their backlog, probably will be ready sometime in Q4 or so).

View solution in original post

11 REPLIES 11

Atanu
Databricks Employee
Databricks Employee

Hello @Nicolino Oppesโ€‹  Currently we don't have the odbc for M1 chip and our engineering team is working on this. May be end of Q3 we can expect the release.

We apologize for the inconvenience caused.

Thanks.

Atanu
Databricks Employee
Databricks Employee

@Nicolino Oppesโ€‹ @Yatindra Athivarapuโ€‹ @Mengdan Liuโ€‹ 

ODBC doesnโ€™t officially support ARM (M1) architecture. So thatโ€™s probably the root cause.However unofficially M1 rosetta emulation is capable of emulating ODBC Intel instruction on M1 and we have many scenarios that ODBC on M1 worked out of the box (Tableau with ODBC on M1 works through rosetta, etc).for short term workarounds:

  • either you can try using anything other than M1 if you have other VMs, machines.
  • the other option is you should play with rosetta emulation on M1 to see if there is a way to make this work (check here) this is unknown territory.
  • it seems this error is coming from excel not ODBC. so maybe you can search if for excel on mac there is any way to disable that additional validation which is failing

long term simba will officially add support for M1 to ODBC (thatโ€™s in their backlog, probably will be ready sometime in Q4 or so).

Yati
New Contributor II

Hey @Atanu Sarkarโ€‹ 

Since we are near the end of Q3, are we expecting a release of ODBC server for M1?

MengdanLiu_
New Contributor II

Hi @Atanu Sarkarโ€‹ , hope you are doing well. May I know if the release of ODBC for M1 chip will be released or not? Thank you.

Nico1
New Contributor II

Hi Databricks Team and @Atanu Sarkarโ€‹ ,

Could I please kindly have an update on the Driver status? There's a deadline in place?

Thanks in advance.

kunalmishra9
New Contributor III

Wanted to follow up here as well! 

Atanu
Databricks Employee
Databricks Employee

@MengdanLiu_  I see from internal note customer is using odbc for M1 . so it's supported now.

kunalmishra9
New Contributor III

I'm ~99% sure that ARM (and Apple Silicon Macs, by extension), are not yet supported. Went down many rabbit holes to attempt configuration of the Databricks ODBC driver and wasn't able to get it up and running. 

The evidence suggesting a lack of support:

  1. The release notes of the Databricks Spark SQL drivers make no mention of it
  2. Similarly, the release notes indicate a new version hasn't been released since 2022-07-12, which predates the first reply to OP.
  3. In my Terminal, the command `file /Library/simba/spark/lib/libsparkodbc_sbu.dylib` shows compilation for `i386` and `x86_64`, but not `arm64e`.
  4. During my rabbit hole exploration to set up ODBC, I stumbled across blogs like this one, indicating the issue still exists and requires a rather massive lift to solve for when using with R & RStudio.
 

Atanu
Databricks Employee
Databricks Employee

I have installed to my M1 chip Mac on Friday,.

I will be doing a couple of testing. and share the update.

kunalmishra9
New Contributor III

Have good news to report on this end:

- A new version of the ODBC driver was released on 2023-09-08 (I spoke with a Databricks engineer the day prior about this) 

- The latest version of the driver is indeed compiled for arm64 and supports Apple Silicon natively

- Still working to get things set up but there was at least progress on this

 

kunalmishra9
New Contributor III

Things seem to be mostly working for me now. I've added a bit more detail on my connection steps and process in case it's helpful for anyone on Stack Overflow: https://stackoverflow.com/questions/76407426/connecting-rstudio-desktop-to-databricks-community-edit...

 
 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group