Spark Error/Exception Handling

[Kristof]

I am creating new application and looking for ideas how to handle exceptions in Spark, for example ThreadPoolExecution.

Are there any good practice in terms of error handling and dealing with specific exceptions ?

[Shalabh007 · Accepted solution]

@Krzysztof Nojman​ I found below 2 links which could be relevant to you.

https://anish749.github.io/spark/exception-handling-spark-data-frames/

https://medium.com/@mcamara89/handling-exceptions-in-apache-spark-7ef65953ba7b

[Kristof]

Thanks for tips, I will have a look

[Shalabh007]

@Krzysztof Nojman​ 

Can you please click on the "Select As Best" button if you find the information provided helps resolve your question.