Hello, I appreciate your response.

I understand your point. I have tested Delta Live Tables (DLT) with incrementally materialized views of various query sizes, and I'm not impressed with the results. I imagine that the engine will continue to improve, but the lack of information about the procedures used by DLT and its internal mechanisms is not what I expected at this time. Databricks has always been a company that values transparency and open-source technologies. Don't get me wrong—I love the platform, and I'm just sharing my perspective.

I created a simple library that applies changes incrementally using Spark Structured Streaming, and it is working well.