Libraries Not Working on Shared Cluster 13.3 LTS

ywaihong6123 — Thu, 24 Aug 2023 01:21:00 GMT

I am facing this error while installing the spark-excel library into the cluster. Does anyone know how to add library into artifact allowlist?

Jars and Maven Libraries on Shared Clusters must be on the allowlist. Failed Libraries: com.crealytics:spark-excel_2.12:3.4.1_0.19.0: PERMISSION_DENIED: 'com.crealytics:spark-excel_2.12:3.4.1_0.19.0' is not in the artifact allowlist

Re: Libraries Not Working on Shared Cluster 13.3 LTS

User16752239289 — Wed, 30 Aug 2023 18:36:18 GMT

You can add the jar followed below steps:

How to add items to the allowlist

You can add items to the allowlist with Data Explorer or the REST API.

To open the dialog for adding items to the allowlist in Data Explorer, do the following:

In your Databricks workspace click the Data button
Click gear button to open the metastore details and permissions UI.
Select Allowed JARs/Init Scripts.
Click Add.

Add a JAR to the allowlist

Complete the following steps to add a JAR to the allowlist:

For Type, select JAR.
For Source Type, select Volume or the object storage protocol.
Specify the source path to add to the allowlist. See How are permissions on paths enforced in the allowlist?.

Please note you must be the metastore admin to add the jar.

For more details, please check here https://docs.databricks.com/en/data-governance/unity-catalog/manage-privileges/allowlist.html#how-to-add-items-to-the-allowlist

topic Re: Libraries Not Working on Shared Cluster 13.3 LTS in Data Engineering

Libraries Not Working on Shared Cluster 13.3 LTS

Re: Libraries Not Working on Shared Cluster 13.3 LTS

How to add items to the allowlist

Add a JAR to the allowlist