Databricks

RasmusOlesen · 10-26-2021

We get errors like this,Recursive view `x` detected (cycle: `x` -> `x`).. in our long-term working code, that has worked just fine in Spark 2.4.5 (Runtime 6.4), when we run it on a Spark 3.2 cluster (Runtime 10.0).It happens whenever we have,<x is a ...

RasmusOlesen · 08-09-2021

We have multiple DB clusters (6.4 Extended Support) that have not changed in terms of libs installed or nodes etc. Sudden from one day to the other, after a cluster restart August 7th, they stopped installing ciso8601 lib as they would usually. Anyb...

RasmusOlesen · 10-27-2021

Thanks a lot Hubert,Could it be a bug where Spark 3.2's createOrReplaceTempView is accidentally calling/using the global database and not the/a "default" one?We implemented a temp makeshift system where the names we register are unique via timestamp...

RasmusOlesen · 10-25-2021

Just to close this old qustion:We solved this by switching to a PEP517 free pip install, using the a Global Init Script:/databricks/python/bin/pip install ciso8601 --disable-pip-version-check --no-use-pep517Now it works for us.

RasmusOlesen · 08-09-2021

Output from the lib installation under the Clusters page (Pypi: ciso8601) java.lang.RuntimeException: ManagedLibraryInstallFailed: org.apache.spark.SparkException: Process List(/databricks/python/bin/pip, install, ciso8601, --disable-pip-version-che...

Databricks

User Stats

User Activity

Upgrading from Spark 2.4 to 3.2: Recursive view errors when using

ciso8601 library stopped installing out of the blue on DB clusters

Re: Upgrading from Spark 2.4 to 3.2: Recursive view errors when using

Re: ciso8601 library stopped installing out of the blue on DB clusters

Re: ciso8601 library stopped installing out of the blue on DB clusters