cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Maven library installation issue on 15.4 LTS

Rakesh007
New Contributor

recently i upgraded from 10.4LTS databricks runtime version to 15.4LTS version. while installing Maven library i was facing issue like :

Library installation attempted on the driver node of cluster 0415-115331-dune977 and failed. Library resolution failed. Error code: ERROR_MAVEN_LIBRARY_RESOLUTION, error message: Library resolution failed because unresolved dependency: com.crealytics:spark-excel_2.11:0.12.2: not found

I tried all this = com.crealytics:spark-excel_2.12:3.1.3_0.18.4
com.crealytics:spark-excel_2.12:3.5.1_0.20.4
com.crealytics:spark-excel_2.12:0.20.3 still facing same issue as above show. so please help me to fix this issue

3 REPLIES 3

Isi
Contributor

Hey @Rakesh007 

I faced a similar issue a few months ago with this library:

https://github.com/nightscape/spark-excel/discussions/834

I assume you’re currently using Unity Catalog — it seems to introduce some compatibility issues, and unfortunately, the library hasn’t been updated to address them yet.

Anyway make sure that you got it avaiable in allowed JARs/Init Script  inside Catalog>Metastore>allowed JARs/Init Script

Hope this helps! 🙂

Isi

Rakesh007
New Contributor

Hi thank you for your replie, But here are not using Unity Catalog

User16611530679
Databricks Employee
Databricks Employee

Hi @Rakesh007, Good Day!

This seems to be a compatibility issue with the Apache Spark version, as the DBR 15.4LTS supports 3.5.0. Please try installing the below version and let us know how it goes?

Version: 
com.crealytics:spark-excel_2.12:3.5.0_0.20.3

Reference:

https://mvnrepository.com/artifact/com.crealytics/spark-excel_2.13/3.5.0_0.20.3

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group