Hi! I'm looking for any ETL or Transformations Testing Framework for Databricks -
need to support automation of the following steps:
1) create/store test datasets (mock inputs and a golden copy of the output),
2) run ETL (notebook) being tested
3) compare ETL output with the golden copy
Any examples or ready to use options out there?