https://community.databricks.com/t5/data-engineering/databricks-connect-cannot-cross-line-reference-when-using-lambda/m-p/24900#M17320 <P>Hi</P><P>run below code line at spark-shell through db-connect</P><P><span class="lia-inline-image-display-wrapper" image-alt="image.png"><img src="https://community.databricks.com/t5/image/serverpage/image-id/1995i2F662E403691A7CD/image-size/large?v=v2&amp;px=999" role="button" title="image.png" alt="image.png" /></span>It throw exception:</P><PRE><CODE>java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in instance of org.apache.spark.rdd.MapPartitionsRDD</CODE></PRE><P>When use the code block:</P><P><span class="lia-inline-image-display-wrapper" image-alt="image"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2011iBF7060AA619B24B5/image-size/large?v=v2&amp;px=999" role="button" title="image" alt="image" /></span>It works well.</P><P></P><P>Can you help with this?</P><P><I>databricks-connect version: </I>"databricks-connect==7.3.*"</P><P><I>runtime: "7.3LTS"</I></P> Wed, 23 Mar 2022 07:32:51 GMT ayzm 2022-03-23T07:32:51Z https://community.databricks.com/t5/data-engineering/databricks-connect-cannot-cross-line-reference-when-using-lambda/m-p/24900#M17320 <P>Hi</P><P>run below code line at spark-shell through db-connect</P><P><span class="lia-inline-image-display-wrapper" image-alt="image.png"><img src="https://community.databricks.com/t5/image/serverpage/image-id/1995i2F662E403691A7CD/image-size/large?v=v2&amp;px=999" role="button" title="image.png" alt="image.png" /></span>It throw exception:</P><PRE><CODE>java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in instance of org.apache.spark.rdd.MapPartitionsRDD</CODE></PRE><P>When use the code block:</P><P><span class="lia-inline-image-display-wrapper" image-alt="image"><img src="https://community.databricks.com/t5/image/serverpage/image-id/2011iBF7060AA619B24B5/image-size/large?v=v2&amp;px=999" role="button" title="image" alt="image" /></span>It works well.</P><P></P><P>Can you help with this?</P><P><I>databricks-connect version: </I>"databricks-connect==7.3.*"</P><P><I>runtime: "7.3LTS"</I></P> Wed, 23 Mar 2022 07:32:51 GMT https://community.databricks.com/t5/data-engineering/databricks-connect-cannot-cross-line-reference-when-using-lambda/m-p/24900#M17320 ayzm 2022-03-23T07:32:51Z