topic Does exist the ability to run jobs with integration tests from the Databricks interface? in Data Engineering

Does exist the ability to run jobs with integration tests from the Databricks interface?

DevOps88 — Fri, 02 Dec 2022 16:25:15 GMT

Currently, Nutter could be run inside a common CI/CD pipeline from GitLab, but need the possibility to run jobs with integration tests from the Databricks interface.

How to use Nutter directly from Databricks?

Does exist any integration test examples and documentation?

Any alternative easy solutions?

Re: Does exist the ability to run jobs with integration tests from the Databricks interface?

UmaMahesh1 — Fri, 02 Dec 2022 17:16:03 GMT

Hi @Dmitrii Kalashnikov

If you want to directly run tests from the interface, you can do that by installing Nutter using PyPi on databricks cluster.

This blog might help you further...

https://damle-amit075.medium.com/a-2minute-guide-to-unit-test-your-databricks-notebooks-b1c2c937b0b

Do ping for queries so that community can help...

Cheers..

Re: Does exist the ability to run jobs with integration tests from the Databricks interface?

jose_gonzalez — Mon, 30 Jan 2023 19:27:33 GMT

Hi @Dmitrii Kalashnikov,

You could find examples and more details here https://github.com/alexott/databricks-nutter-repos-demo