I don’t think the old schema grant is necessarily the only long-term answer.
Even after the original streaming tables are dropped, a Lakeflow pipeline can still have hidden artifacts that reference the prior schema. In practice, the main things I’d l...
Then I think this feature could close the gap external data access for pipeline datasets It requires Delta 4.0+ via UC APIs support which DuckDB already supports.Compatibility Mode vs External Data Access ModeIf that is not a path, then a CDF/MERGE c...
Have you looked into Compatibility Mode? It is explicitly built to generate a read-only compatibility version of streaming tables/materialized views at a chosen location and keep it refreshed automatically after updates.
