What is a good way to implement unit tests using github actions for databricks?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-10-2023 07:13 AM
I am trying to use a git template for unit tests on a databricks project. The framework uses pylint, pytest and black to check the code. But I am having a lot of trouble getting the github actions vm to run the code without issues. I have had issues with spark and hadoop versions, packages, java errors. Is it even a good idea to have github actions fire up a vm that is identical to my databricks environment and test the code? Is there another more sensible approach, such using the run-notebook action instead? Should I look into some completely different framework for doing unit tests?
Labels:
- Labels:
-
Unit Tests