Databricks

gud4eve · 04-10-2023

We are migrating our Scala jobs from AWS EMR (6.2.1 and Spark version - 3.0.1) to Lakehouse and few of our jobs are failing due to NullPointerException. We tried in Databricks Runtime 7.3 LTS, it is working fine. Because it had same spark version 3.0...

gud4eve · 10-09-2022

We are migrating from AWS EMR to Databricks. One thing that we have noticed during the POCs is that Databricks cluster of same size and instance type takes much lesser time to start compared to EMR.My understanding is Databricks also would be request...

gud4eve · 04-10-2023

In one of my code statements, I updated scala Boolean to java.lang.Boolean and this is working fine now. May be in new newer Spark versions, null in scala Boolean isn't supported.

gud4eve · 10-18-2022

No we haven't configured pools

gud4eve · 10-10-2022

yes that's my assumption too. But do we have any documentation by Databricks stating that?

Databricks

User Stats

User Activity

Scala app getting NullPointerException while migrating from DBR 7.3 to 9.1 (and above)

Why is Databricks on AWS cluster start time less than 5 mins and EMR cluster start time is 15 mins?

Re: Scala app getting NullPointerException while migrating from DBR 7.3 to 9.1 (and above)

Re: Why is Databricks on AWS cluster start time less than 5 mins and EMR cluster start time is 15 mins?

Re: Why is Databricks on AWS cluster start time less than 5 mins and EMR cluster start time is 15 mins?