What libraries could be used for unit testing of the Spark code?

alexott
Databricks Employee
Databricks Employee

We need to add unit test cases for our code that we're writing using the Scala in Python. But we can't use the calls like `assertEqual` for comparing the content of DataFrames. Are any special libraries for that?