https://community.databricks.com/t5/data-engineering/databricks-connect-error-occurred-while-running-java-io/m-p/6486#M2606 <P>Hi, I am not sure if this helps:</P><P><A href="https://stackoverflow.com/questions/10775709/java-io-streamcorruptedexception-invalid-type-code-00" alt="https://stackoverflow.com/questions/10775709/java-io-streamcorruptedexception-invalid-type-code-00" target="_blank">https://stackoverflow.com/questions/10775709/java-io-streamcorruptedexception-invalid-type-code-00</A></P><P><A href="https://www.geeksforgeeks.org/how-to-fix-java-io-streamcorruptedexception-invalid-type-code-in-java/" alt="https://www.geeksforgeeks.org/how-to-fix-java-io-streamcorruptedexception-invalid-type-code-in-java/" target="_blank">https://www.geeksforgeeks.org/how-to-fix-java-io-streamcorruptedexception-invalid-type-code-in-java/</A></P><P>Please tag&nbsp;<A href="https://community.databricks.com/s/profile/0053f000000WWwvAAG" alt="https://community.databricks.com/s/profile/0053f000000WWwvAAG" target="_blank">@Debayan</A>​&nbsp;with your next response which will notify me. Thank you!</P> Tue, 04 Apr 2023 05:14:08 GMT Debayan 2023-04-04T05:14:08Z https://community.databricks.com/t5/data-engineering/databricks-connect-error-occurred-while-running-java-io/m-p/6485#M2605 <P>I am using databricks-connect to access a remote cluster. Everything works as expected and I can set breakpoints and interrogate the results, same for when it trys to execute the following code:</P><P></P><P>val testDF = spark.createDataFrame(spark.sparkContext</P><P> .emptyRDD[Row], StructType(</P><P> <I>Array</I>(</P><P> StructField("prop1", StringType),</P><P> StructField("prop2", StringType),</P><P> StructField("prop3", StringType),</P><P> )))</P><P></P><P></P><P><I>logLn</I>("Test DF count: " + testDF.count())</P><P></P><P>I am running this from Intellij. Any help or pointers would be much appreciated.</P><P></P><P>UPDATE:</P><P>The first cluster I was targeting was 11.3.* and I got the error. I tried testing against a 7.3 and it worked as expected. I then tested against 10.4 and got the above error.</P><P></P><P>Full text of error:</P><P>java.io.StreamCorruptedException: invalid type code: 00</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1700)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503)</P><P> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461)</P><P> at scala.collection.immutable.List$SerializationProxy.readObject(List.scala:527)</P><P> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)</P><P> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)</P><P> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)</P><P> at java.lang.reflect.Method.invoke(Method.java:498)</P><P> at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1184)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2322)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.readArray(ObjectInputStream.java:2119)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1657)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503)</P><P> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461)</P><P> at scala.collection.immutable.List$SerializationProxy.readObject(List.scala:527)</P><P> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)</P><P> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)</P><P> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)</P><P> at java.lang.reflect.Method.invoke(Method.java:498)</P><P> at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1184)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2322)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.readArray(ObjectInputStream.java:2119)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1657)</P><P> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)</P><P> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)</P><P> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)</P><P> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)</P><P> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503)</P><P> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461)</P><P> at org.apache.spark.sql.util.ProtoSerializer.$anonfun$deserializeObject$1(ProtoSerializer.scala:7248)</P><P>...</P><P></P><P></P><P></P> Mon, 03 Apr 2023 23:00:23 GMT https://community.databricks.com/t5/data-engineering/databricks-connect-error-occurred-while-running-java-io/m-p/6485#M2605 DBJmet 2023-04-03T23:00:23Z https://community.databricks.com/t5/data-engineering/databricks-connect-error-occurred-while-running-java-io/m-p/6487#M2607 <P>Hi @James Metcalf​&nbsp;</P><P></P><P>Thank you for posting your question in our community! We are happy to assist you.</P><P></P><P>To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?</P><P></P><P>This will also help other community members who may have similar questions in the future.</P><P></P><P> Thank you for your participation and let us know if you need any further assistance!&nbsp;</P><P></P><P></P> Wed, 05 Apr 2023 05:50:29 GMT https://community.databricks.com/t5/data-engineering/databricks-connect-error-occurred-while-running-java-io/m-p/6487#M2607 Anonymous 2023-04-05T05:50:29Z https://community.databricks.com/t5/data-engineering/databricks-connect-error-occurred-while-running-java-io/m-p/6486#M2606 <P>Hi, I am not sure if this helps:</P><P><A href="https://stackoverflow.com/questions/10775709/java-io-streamcorruptedexception-invalid-type-code-00" alt="https://stackoverflow.com/questions/10775709/java-io-streamcorruptedexception-invalid-type-code-00" target="_blank">https://stackoverflow.com/questions/10775709/java-io-streamcorruptedexception-invalid-type-code-00</A></P><P><A href="https://www.geeksforgeeks.org/how-to-fix-java-io-streamcorruptedexception-invalid-type-code-in-java/" alt="https://www.geeksforgeeks.org/how-to-fix-java-io-streamcorruptedexception-invalid-type-code-in-java/" target="_blank">https://www.geeksforgeeks.org/how-to-fix-java-io-streamcorruptedexception-invalid-type-code-in-java/</A></P><P>Please tag&nbsp;<A href="https://community.databricks.com/s/profile/0053f000000WWwvAAG" alt="https://community.databricks.com/s/profile/0053f000000WWwvAAG" target="_blank">@Debayan</A>​&nbsp;with your next response which will notify me. Thank you!</P> Tue, 04 Apr 2023 05:14:08 GMT https://community.databricks.com/t5/data-engineering/databricks-connect-error-occurred-while-running-java-io/m-p/6486#M2606 Debayan 2023-04-04T05:14:08Z