topic Re: Maven Libraries are failing on restarting the cluster. in Data Engineering

Maven Libraries are failing on restarting the cluster.

Gandham — Sat, 28 Jan 2023 18:30:02 GMT

I have installed "com.databricks:spark-xml_2.12:0.16.0" maven libraries to a cluster. The installation was successful. But when I restart the cluster, even this successful installation becomes failed. This happens with all Maven Libraries.

Here is the error message:

Library installation attempted on the driver node of cluster 0502-152920-976jb2gj and failed. Please refer to the following error message to fix the library or contact Databricks support. Error Code: DRIVER_LIBRARY_INSTALLATION_FAILURE. Error Message: Library resolution failed because org.jvnet.jaxb2.maven2:maven-jaxb2-plugin-project download failed.

Re: Maven Libraries are failing on restarting the cluster.

Ajay-Pandey — Sun, 29 Jan 2023 05:41:36 GMT

Hi @Raja Gandham It's working fine for me find below snapshot-

Please create a support ticket for the same.

Re: Maven Libraries are failing on restarting the cluster.

Hubert-Dudek — Mon, 30 Jan 2023 18:27:52 GMT

Please check network routing. From DBR 11 LTS installation is done in the data plane (before was in the control plane). So basically, your cluster needs to have connectivity to https://repo.maven.apache.org/maven2/ when starting.

Additionally, it is not supported on shared unity catalog cluster.

Re: Maven Libraries are failing on restarting the cluster.

Aviral-Bhardwaj — Tue, 31 Jan 2023 03:37:26 GMT

it is intermittent issue, we also faced this issue earlier ,try to upgrade DBR version