Expectation in DLT using multiple columns
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-12-2025 07:47 PM
Is it possible to define an expectation in DLT pipeline using multiple columns?
For example, my source has two fields - Division, Material_Number.
For division 20, material number starts with 5; for 30 material number starts with 9.
Can we have this data quality check in an expectation?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-12-2025 09:56 PM
Hi @Master_DataBric , Yes its possible
Here is the doc link :
- https://docs.databricks.com/aws/en/dlt/expectations?language=Python
- https://docs.databricks.com/aws/en/dlt/expectations?language=SQL
