Issue importing library deltalake

[Gcabrera]

Hello,

I'm currently seeing a rather cryptic error message whenever I try to import the deltalake library into Databricks (without actually doing anything else).

import datalake

"ImportError: /local_disk0/.ephemeral_nfs/envs/pythonEnv-cbe496f6-d064-40ae-87c0-ab3d3c23ccb3/lib/python3.9/site-packages/deltalake/_internal.abi3.so: cannot allocate memory in static TLS block"

However the library seems to work just fine locally or within an SH cell.

I have tried quite a few things but nothing really seems to work:

1. Installing various versions of the library (and its dependencies).
2. Installing the library via %pip %sh !pip or the cluster/job tab.
3. Setting a system variable in an SH cell: export LD_PRELOAD
4. Restarting python interpreter.
5. Increasing cluster memory.
6. Only importing a single class from the library.

Any insight you may have would be greatly appreciated.

Best regards,

Gustavo

[jose_gonzalez]

Are you trying to import this library to a Databricks notebook? are you using open source spark in your local machine?