topic Permission denied using patchelf in Administration & Architecture

Permission denied using patchelf

Datastoryteller — Wed, 17 Apr 2024 14:04:05 GMT

Hello all 👋

I would like to run a Python script on a Shared cluster:

The Python script tries to do, under the hood, a call to `patchelf` utility, in order to set a r-path. Something along those lines:

execute('patchelf',['--set-rpath', rpath, lib])

The problem I'm facing is that on a Shared cluster, this operation fails with "Operation denied" message. I have no issue when running on a Single User cluster. I tried various permission grants from Catalog > hive_metastore > Permissions, but none of them were successful.

Can I do something to make it work? I must confess that at this point, I'm entirely lost on where to find more configurations that would be helpful.

Any help is appreciated,

Regards

Re: Permission denied using patchelf

Ajay-Pandey — Wed, 17 Apr 2024 14:13:26 GMT

Hi @Datastoryteller

Does Unity Catalog enabled on your workspace ?

Re: Permission denied using patchelf

Datastoryteller — Wed, 17 Apr 2024 14:14:44 GMT

I think it is, but is there a specific config to check? I'm browsing the documentation and I'm a bit lost, to say the least

Re: Permission denied using patchelf

Datastoryteller — Wed, 17 Apr 2024 14:31:08 GMT

I basically followed this tutorial https://learn.microsoft.com/en-gb/azure/databricks/data-governance/unity-catalog/get-started and it seemed to be working, so I guess Unity Catalog is enabled?