cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Permission denied using patchelf

Datastoryteller
New Contributor II

Hello all ๐Ÿ‘‹

I would like to run a Python script on a Shared cluster:

Screenshot 2024-04-17 at 16.00.03.png

โ€ƒThe Python script tries to do, under the hood, a call to `patchelf` utility, in order to set a r-path. Something along those lines:

execute('patchelf',['--set-rpath', rpath, lib])

The problem I'm facing is that on a Shared cluster, this operation fails with "Operation denied" message. I have no issue when running on a Single User cluster. I tried various permission grants from Catalog > hive_metastore > Permissions, but none of them were successful.

Can I do something to make it work? I must confess that at this point, I'm entirely lost on where to find more configurations that would be helpful.

Any help is appreciated,

Regards

3 REPLIES 3

Ajay-Pandey
Esteemed Contributor III

Hi @Datastoryteller 

Does Unity Catalog enabled on your workspace ?

Ajay Kumar Pandey

I think it is, but is there a specific config to check? I'm browsing the documentation and I'm a bit lost, to say the least

Datastoryteller
New Contributor II

I basically followed this tutorial https://learn.microsoft.com/en-gb/azure/databricks/data-governance/unity-catalog/get-started and it seemed to be working, so I guess Unity Catalog is enabled?

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group