Databricks Community

Hi Team,Our source data originates from MongoDB as hierarchical JSON and is ingested into our Silver layer, where it is already normalized into tabular structures. However, primary and foreign key constraints are not enforced during ingestion. We mus...

Hi Team,We need to perform a data quality check between an legacy table and a newly migrated table generated by refactored code. Specifically, we want to validate:Schema & Volumetrics: Total row counts, column counts, and column data type distributio...