DLT, combine LIVE table with data masking and row filter

[hfyhn]

I need to apply data masking and row filters to my table. At the same time I would like to use DLT Live tables. 

However, as far as I can see, DLT Live tables are not compatble with Live tables. 

What are my options? 

Move the tables from out of the materialized view to a table?

Or are Databricks working on a fix for this issue?

[Kaniz_Fatma]

Hi @hfyhn, You’re correct that DLT Live tables don’t inherently support writing data from multiple live tables into a single target Delta table. This means you cannot directly configure two or more DLT pipelines to update the same table simultan....

As for your options, here are a couple of approaches you can consider:

1. Separate Tables: You could maintain separate tables for DLT Live tables and regular Live tables. This way, you avoid the compatibility issue and ensure that each pipeline operates independently.

2. Materialized Views: If you’re currently using materialized views, you might consider transforming them into separate Delta tables. This would allow you to work with DLT Live tables without any compatibility constraints.

Regarding Databricks working on a fix, I recommend checking this forum later. We might provide insights into future enhancements or workarounds once that's available. 😊