topic Re: Maven library installation issue on 15.4 LTS in Data Engineering

Maven library installation issue on 15.4 LTS

Rakesh007 — Sat, 22 Mar 2025 08:16:52 GMT

recently i upgraded from 10.4LTS databricks runtime version to 15.4LTS version. while installing Maven library i was facing issue like :

Library installation attempted on the driver node of cluster 0415-115331-dune977 and failed. Library resolution failed. Error code: ERROR_MAVEN_LIBRARY_RESOLUTION, error message: Library resolution failed because unresolved dependency: com.crealytics:spark-excel_2.11:0.12.2: not found

I tried all this = com.crealytics:spark-excel_2.12:3.1.3_0.18.4
com.crealytics:spark-excel_2.12:3.5.1_0.20.4
com.crealytics:spark-excel_2.12:0.20.3 still facing same issue as above show. so please help me to fix this issue

Re: Maven library installation issue on 15.4 LTS

Isi — Sat, 22 Mar 2025 20:07:53 GMT

Hey @Rakesh007

I faced a similar issue a few months ago with this library:

https://github.com/nightscape/spark-excel/discussions/834

I assume you’re currently using Unity Catalog — it seems to introduce some compatibility issues, and unfortunately, the library hasn’t been updated to address them yet.

Anyway make sure that you got it avaiable in allowed JARs/Init Script inside Catalog>Metastore>allowed JARs/Init Script

Hope this helps! 🙂

Isi

Re: Maven library installation issue on 15.4 LTS

Rakesh007 — Mon, 24 Mar 2025 08:25:13 GMT

Hi thank you for your replie, But here are not using Unity Catalog

Re: Maven library installation issue on 15.4 LTS

User16611530679 — Mon, 24 Mar 2025 09:00:18 GMT

Hi @Rakesh007, Good Day!

This seems to be a compatibility issue with the Apache Spark version, as the DBR 15.4LTS supports 3.5.0. Please try installing the below version and let us know how it goes?

Version: com.crealytics:spark-excel_2.12:3.5.0_0.20.3

Reference:

https://mvnrepository.com/artifact/com.crealytics/spark-excel_2.13/3.5.0_0.20.3