Hi everyone,
I’m looking for the best way to implement integration tests for SQL notebooks in an environment that uses Unity Catalog and workflows to execute these notebooks.
For unit tests on SQL functions, I’ve reviewed the https://docs.databricks.com/en/notebooks/testing.html#language-SQL, and it seems to provide an appropriate approach. However, I’m unsure how to tackle integration testing for complete SQL notebooks.
My goal is to run both unit and integration tests in a CI/CD pipeline using Databricks Asset Bundles. If I were working with Python notebooks, I’d use pytest for unit tests and simulate data in dedicated notebooks for integration tests.
Has anyone faced this kind of challenge with SQL notebooks? How have you approached it? Any advice, experience, or best practices you could share would be greatly appreciated.
Thank you in advance for your help!
