Databricks Community

IM_01

IM_01

Hi, Is there a way to get number of warned records, dropped records , failed records for each expectation I see currently it gives aggregated count

IM_01

Hi,Is there any option to control refresh rate of materialized view such as , even the dlt is triggered in full refresh mode and src Streaming tables are not updated then the full refresh should not happen on mvs . Is there any way to achieve this.

IM_01

Hi,I am currently using Lakeflow SDP ,firstly I am creating 2 views and then joining them and creating materialized view and using order by in the materialized view create function , but the results are not sorted does order by not work on materializ...

IM_01

Hi,I was going through the documentation on quarantining records. Initially I thought that partitioning is not supported for temporary tables however I came cross the following@DP.table( temporary=True, partition_cols=["is_quarantined"], ) @dp.ex...

IM_01

@Ashwin_DSA could you please provide an example .

IM_01

Thanks Ashwin

IM_01

Hi @Ashwin_DSA even on passing table name to the event_log function it returns all the rows. could you please help with thisselect * from event_log(table(workspace.default.customers_summary_mv))

IM_01

Hi @Ashwin_DSA Apologies I was referring to event_log in this case{"dropped_records":0,"warned_records":344,"expectations":[{"name":"valid_case1","dataset":"cat.sch.tb1","passed_records":2505,"failed_records":313},{"name":"valid_case2","dataset":"cat...

IM_01

Thanks Ashwin

Databricks Community

User Stats

User Activity

Can metric views be used to achieve sql cube functionality

Lakeflow SDP expectations

How to disable full refresh on materialized view if the src is not updated since last run

OrderBy is not sorting the results

Partition cols for a temporary table in Lakefow SDP

Re: Can metric views be used to achieve sql cube functionality

Re: Lakeflow SDP expectations

Re: Lakeflow SDP expectations

Re: Lakeflow SDP expectations

Re: OrderBy is not sorting the results