https://community.databricks.com/t5/data-engineering/how-to-use-dlt-expectations-for-uniqueness-checks-on-a-dataset/m-p/83150#M36854 <P>I am using dlt through python to build a DLT pipeline. One of things I would like to do is to check that each incoming row does not exist in the target table; i want to be sure that each row is unique.</P><P>I am confused because it seems like this is not possible through dlt expect. I am under the impression that each expectation works on row-level, not on a table-level. Morever I am not seeing anything about uniqueness constraints and am reading that PKs are not enforced. So, is this possible?</P><P>#dlt #expect</P> Thu, 15 Aug 2024 23:58:18 GMT Zeruno 2024-08-15T23:58:18Z https://community.databricks.com/t5/data-engineering/how-to-use-dlt-expectations-for-uniqueness-checks-on-a-dataset/m-p/83150#M36854 <P>I am using dlt through python to build a DLT pipeline. One of things I would like to do is to check that each incoming row does not exist in the target table; i want to be sure that each row is unique.</P><P>I am confused because it seems like this is not possible through dlt expect. I am under the impression that each expectation works on row-level, not on a table-level. Morever I am not seeing anything about uniqueness constraints and am reading that PKs are not enforced. So, is this possible?</P><P>#dlt #expect</P> Thu, 15 Aug 2024 23:58:18 GMT https://community.databricks.com/t5/data-engineering/how-to-use-dlt-expectations-for-uniqueness-checks-on-a-dataset/m-p/83150#M36854 Zeruno 2024-08-15T23:58:18Z https://community.databricks.com/t5/data-engineering/how-to-use-dlt-expectations-for-uniqueness-checks-on-a-dataset/m-p/99346#M39978 <P>I also have the same doubt, about the implementation of the uniqueness rule</P> Tue, 19 Nov 2024 14:55:09 GMT https://community.databricks.com/t5/data-engineering/how-to-use-dlt-expectations-for-uniqueness-checks-on-a-dataset/m-p/99346#M39978 Mauro 2024-11-19T14:55:09Z