Databricks Community

UlrikChristense · 01-13-2025

I have a lot of DLT tables creating using the `apply_changes` function with type 2 history. This functions creates a physical table `__apply_changes_storage_<table_name>` and a view on top of this `<table_name>`. The number of rows the physical table...

UlrikChristense · 01-22-2025

I'm trying, but doesn't seem to change anything. Setting these table properties - when are the "applied"? When the job is run, or as a background thing?

UlrikChristense · 01-15-2025

Any ideas?

UlrikChristense · 01-14-2025

Suggestion 4 seems to be the only one, which might actually reduce the number of rows in the physical table. However, i can't get it to work. I have set this property to 0, yet the number of hidden rows remains the same.

Databricks Community

User Stats

User Activity

Apply-changes-table (SCD2) with huge amounts of `rowIsHidden=True` rows

Re: Apply-changes-table (SCD2) with huge amounts of `rowIsHidden=True` rows

Re: Apply-changes-table (SCD2) with huge amounts of `rowIsHidden=True` rows

Re: Apply-changes-table (SCD2) with huge amounts of `rowIsHidden=True` rows