cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

can view allow_expectations_col in unit catalog

tebodelpino1234
New Contributor

I am developing a dlt that manages expectations and it works correctly.

tebodelpino1234_0-1739993377613.png

but I need to see the columns

__DROP_EXPECTATIONS_COL
__MEETS_DROP_EXPECTATIONS
__ALLOW_EXPECTATIONS_COL

in the unified catalog, I can see them in the delta table that the dlt generates, but not in the unified catalog.

tebodelpino1234_1-1739993707990.png

tebodelpino1234_2-1739993775604.png

 

 




1 REPLY 1

kamal_ch
Databricks Employee
Databricks Employee

Materialization tables created by DLT include these columns to process expectations but they might not propagate to Unity Catalog representations such as views or schema-level metadata unless explicitly set up for such lineage or column-level exposure

A limitation or feature gap might be causing these columns to appear in the Delta table produced by DLT but not in the Unity Catalog, as Unity Catalog focuses on governance and schema definitions rather than operational details of DLT pipelines.

If needing those columns in Unity Catalog for governance or operational tracking, please consult Databricks support to determine if there's a configuration for such propagation.

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now