topic Re: ciso8601 library stopped installing out of the blue on DB clusters in Data Engineering

ciso8601 library stopped installing out of the blue on DB clusters

RasmusOlesen — Mon, 09 Aug 2021 09:07:29 GMT

We have multiple DB clusters (6.4 Extended Support) that have not changed in terms of libs installed or nodes etc.

Sudden from one day to the other, after a cluster restart August 7th, they stopped installing ciso8601 lib as they would usually.

Anybody know what would cause this?

We have literally changed nothing on the clusters.

Re: ciso8601 library stopped installing out of the blue on DB clusters

SarahPedersen — Mon, 09 Aug 2021 09:10:05 GMT

We also have 6.4 cluster and our ciso doesn't work either.

Re: ciso8601 library stopped installing out of the blue on DB clusters

RasmusOlesen — Mon, 09 Aug 2021 09:11:41 GMT

Output from the lib installation under the Clusters page (Pypi: ciso8601)

java.lang.RuntimeException: ManagedLibraryInstallFailed: org.apache.spark.SparkException: Process List(/databricks/python/bin/pip, install, ciso8601, --disable-pip-version-check) exited with code 1. Command "/databricks/python3/bin/python3.7 /databricks/python3/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py get_requires_for_build_wheel /tmp/tmpp25i_3y_" failed with error code 1 in /tmp/pip-install-xva3elqs/ciso8601
 for library:PythonPyPiPkgId(ciso8601,None,None,List()),isSharedLibrary=false

Re: ciso8601 library stopped installing out of the blue on DB clusters

SarahPedersen — Mon, 09 Aug 2021 09:14:17 GMT

We have the same problem. We're also running on a 6.4 cluster and get the same error

Re: ciso8601 library stopped installing out of the blue on DB clusters

siddhathPanchal — Mon, 27 Sep 2021 15:53:41 GMT

Hey @Sarah Pedersen and @Rasmus Olesen . I am able to download that library successfully on my DBR 6.4 cluster. Please look at the SS attached. If you are using any outdated version of that library, I would highly suggest to use the latest version of that library and install it from the cluster UI.

Re: ciso8601 library stopped installing out of the blue on DB clusters

RasmusOlesen — Mon, 25 Oct 2021 08:34:50 GMT

Just to close this old qustion:

We solved this by switching to a PEP517 free pip install, using the a Global Init Script:

/databricks/python/bin/pip install ciso8601 --disable-pip-version-check --no-use-pep517

Now it works for us.