Hello @Advika i would like to share a technical blog on "Metadata-driven Databricks framework that standardizes data quality checks across multiple sources" in the databricks community.Kindly share the relevant steps on achieving this. thanks in adva...
Hello @Daniel_B Good catch! The health_silver() definition should use table_properties={"quality": "silver"} to keep the table metadata consistent with the intended medallion layer.It would also be useful to include an integration-test assertion that...
Hi @J-Data One thing worth distinguishing here is successful OAuth authentication versus successful API access. OAuth can complete successfully, but the connector may still fail when it tries to discover Salesforce objects or retrieve their metadata....
Hi @krishgarikipati For this architecture, I'd keep Bronze as an immutable, replayable CDC layer and use Lakeflow AUTO CDC in Silver, provided HVR supplies reliable source sequencing metadata.The key is to order changes using source transaction seque...
Hi @elias2 The practical options are:- For Lakehouse//RT: Contact a Databricks account representative and ask whether beta access can be enabled for a trial or paid account in a supported region(if this is for a company use case).For hands-on learnin...
