Looks like it ugly hits some limit of nested messages in protobuf.Because this script generates a flat plan (as opposed to my example in the previous message) and works fine:col_num = 1000
data = [tuple([f'val_{n}' for n in range(1, col_num + 1)])]
d...
I have the same issue, but with databricks-connect==13.2.1Code to reproduce:col_num = 49
data = [tuple([f'val_{n}' for n in range(1, col_num + 1)])]
df = spark.createDataFrame(data=data)
for i in range(1, len(data[0]) + 1):
df = df.withColumnRena...
