Query silently failed

[Anonymous]

Hello all, I'm using the older 6.4 runtime and noticed that a query return no result whereas the same query on 10.4 provided the expected result.

This is bad, because I got no error, simply no result at all.

Is there is some spark settings on the cluster that force a "fail" status in that cases?

I can replicate the error.

[Kaniz]

Hi @Alessio Palma​ ,

Please note:-

Support for Databricks Runtime 6.4 ended on April 1, 2021, due to the end of support for its underlying Ubuntu operating system.

Databricks recommends upgrading to Databricks Runtime 7. x or 8. x to get the benefits of Apache Spark™ 3. x and the many new features and improvements built into these newer runtimes. For migration information, see Databricks Runtime 7. x migration guide.

You can migrate to Databricks Runtime 6.4 Extended Support, which is identical to Databricks Runtime 6.4 apart from the operating system version, JDK, and a small number of R and Python libraries. See Databricks Runtime 6.4 Extended Support.

[Anonymous]

Hi @Alessio Palma​ following up did you get chance to check @Kaniz Fatma​ 's previous comments ?

[Kaniz]

Hi @Alessio Palma​, We haven’t heard from you on the last response from me, and I was checking back to see if you have a resolution yet. If you have any solution, please do share that same with the community as it can be helpful to others. Otherwise, we will respond with more details and try to help.

Thanks.