[Databricks Connect] Cannot cross line reference when using lambda expression through db-connect

ayzm
New Contributor

Hi

run below code line at spark-shell through db-connect

image.pngIt throw exception:

java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in instance of org.apache.spark.rdd.MapPartitionsRDD

When use the code block:

imageIt works well.

Can you help with this?

databricks-connect version: "databricks-connect==7.3.*"

runtime: "7.3LTS"