https://community.databricks.com/t5/data-engineering/can-view-allow-expectations-col-in-unit-catalog/m-p/119332#M45839 <P>Materialization tables created by DLT include these columns to process expectations but they might not propagate to Unity Catalog representations such as views or schema-level metadata unless explicitly set up for such lineage or column-level exposure</P> <P>A limitation or feature gap might be causing these columns to appear in the Delta table produced by DLT but not in the Unity Catalog, as Unity Catalog focuses on governance and schema definitions rather than operational details of DLT pipelines.</P> <P>If needing those columns in Unity Catalog for governance or operational tracking, please consult Databricks support to determine if there's a configuration for such propagation.</P> Thu, 15 May 2025 13:30:40 GMT kamal_ch 2025-05-15T13:30:40Z https://community.databricks.com/t5/data-engineering/can-view-allow-expectations-col-in-unit-catalog/m-p/110665#M43634 <P>I am developing a dlt that manages expectations and it works correctly.<BR /><BR /></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="tebodelpino1234_0-1739993377613.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/14967i74F2476314BA8C9F/image-size/medium?v=v2&amp;px=400" role="button" title="tebodelpino1234_0-1739993377613.png" alt="tebodelpino1234_0-1739993377613.png" /></span></P><P>but I need to see the columns</P><P>__DROP_EXPECTATIONS_COL<BR />__MEETS_DROP_EXPECTATIONS<BR />__ALLOW_EXPECTATIONS_COL</P><P>in the unified catalog, I can see them in the delta table that the dlt generates, but not in the unified catalog.<BR /><BR /></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="tebodelpino1234_1-1739993707990.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/14968i13FC09F7391EE20D/image-size/medium?v=v2&amp;px=400" role="button" title="tebodelpino1234_1-1739993707990.png" alt="tebodelpino1234_1-1739993707990.png" /></span></P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="tebodelpino1234_2-1739993775604.png" style="width: 400px;"><img src="https://community.databricks.com/t5/image/serverpage/image-id/14969iF1263B0F13B57473/image-size/medium?v=v2&amp;px=400" role="button" title="tebodelpino1234_2-1739993775604.png" alt="tebodelpino1234_2-1739993775604.png" /></span></P><P>&nbsp;</P><P>&nbsp;</P><P><BR /><BR /><BR /></P> Wed, 19 Feb 2025 19:36:58 GMT https://community.databricks.com/t5/data-engineering/can-view-allow-expectations-col-in-unit-catalog/m-p/110665#M43634 tebodelpino1234 2025-02-19T19:36:58Z https://community.databricks.com/t5/data-engineering/can-view-allow-expectations-col-in-unit-catalog/m-p/119332#M45839 <P>Materialization tables created by DLT include these columns to process expectations but they might not propagate to Unity Catalog representations such as views or schema-level metadata unless explicitly set up for such lineage or column-level exposure</P> <P>A limitation or feature gap might be causing these columns to appear in the Delta table produced by DLT but not in the Unity Catalog, as Unity Catalog focuses on governance and schema definitions rather than operational details of DLT pipelines.</P> <P>If needing those columns in Unity Catalog for governance or operational tracking, please consult Databricks support to determine if there's a configuration for such propagation.</P> Thu, 15 May 2025 13:30:40 GMT https://community.databricks.com/t5/data-engineering/can-view-allow-expectations-col-in-unit-catalog/m-p/119332#M45839 kamal_ch 2025-05-15T13:30:40Z