Databricks Community

HeijerM84 · 03-04-2024

We have a cluster running on 13.3 LTS (includes Apache Spark 3.4.1, Scala 2.12).We want to test with a different type of cluster (14.3 LTS (includes Apache Spark 3.5.0, Scala 2.12))And all of a sudden we get errors that complain about a casting a Big...

HeijerM84 · 03-26-2024

The example is a simplified query to illustrate the situation. The join condition is not a factor in this issue. The factors that cause the issues are the row_number, union and layered select.

HeijerM84 · 03-06-2024

I have found when the issue arises. Below is a simplified version of the situation.I create a temporary VIEW called ‘v_dim_One’ with a random column and a rownum which has a maximum value of for example 200.%sqlCREATE OR REPLACE GLOBAL TEMPORARY VIEW...

HeijerM84 · 03-06-2024

Hi, Thanks for your response. The error shows the below message as the place where the error is thrown. I don't see how this helps me, as I don't have much knowledge of Spark and Java. Does this message make any sense to you and if so, does that resu...

Databricks Community

User Stats

User Activity

Databricks runtime 14.3 gives error scala.math.BigInt cannot be cast to java.lang.Integer

Re: Databricks runtime 14.3 gives error scala.math.BigInt cannot be cast to java.lang.Integer

Re: Databricks runtime 14.3 gives error scala.math.BigInt cannot be cast to java.lang.Integer

Re: Databricks runtime 14.3 gives error scala.math.BigInt cannot be cast to java.lang.Integer