- 2192 Views
- 3 replies
- 3 kudos
Hi,Do you know any good resources about Databricks performance improvements(like improving query performances, monitoring/resolving performance bottlenecks etc)?Thanks
- 2192 Views
- 3 replies
- 3 kudos
Latest Reply
Hi @Ömer Özsakarya We haven't heard from you since the last response from @Lakshay Goel , and I was checking back to see if her suggestions helped you.Or else, If you have any solution, please share it with the community, as it can be helpful to ...
2 More Replies
by
Robbie
• New Contributor III
- 2636 Views
- 1 replies
- 2 kudos
I'm having difficulty with a job (parent) that triggers multiple parallel runs of another job (child) in batches (e.g. 10 parallel runs per batch).Occasionally some of the parallel "child" jobs will crash a few minutes in-- either during or immediate...
- 2636 Views
- 1 replies
- 2 kudos
Latest Reply
It is MariaDB JDBC error so probably database which you are trying to connect can not handle this amount of concurrent connections (alternatively if you are not connecting to MariaDB databse, MariaDB is used also for hive metastore in your case maria...
by
msj50
• New Contributor III
- 11495 Views
- 10 replies
- 1 kudos
My company urgently needs help, we are having severe performance problems with spark and are having to switch to a different solution if we don't get to the bottom of it.
We are on 1.3.1, using spark SQL, ORC Files with partitions and caching in me...
- 11495 Views
- 10 replies
- 1 kudos
Latest Reply
In my project, following solutions were launched one-by-one to improve performance
To store middle-level result, use memory cache instead of HDFS (like: Ignite Cache) Only use spark for complicated data aggregation, to simple result, just do it on d...
9 More Replies
