What is a good way to implement unit tests using github actions for databricks?

Ullsokk
New Contributor III

I am trying to use a git template for unit tests on a databricks project. The framework uses pylint, pytest and black to check the code. But I am having a lot of trouble getting the github actions vm to run the code without issues. I have had issues with spark and hadoop versions, packages, java errors. Is it even a good idea to have github actions fire up a vm that is identical to my databricks environment and test the code? Is there another more sensible approach, such using the run-notebook action instead? Should I look into some completely different framework for doing unit tests?