- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-24-2025 01:28 PM
Hi Dharinip,
How are you doing today? As per my understanding, it looks like your Materialized View is falling back to full recompute because the source data or query isn't eligible for incremental updates. Based on the message, there are a few blockers: one is that your source is not in Delta format ("INPUT_NOT_IN_DELTA"), which is required for incremental refresh. Another issue is that the query plan includes an unsupported operator (DataSourceV2Relation), and parts of your query might also be considered non-deterministic, meaning the system can’t safely track changes over time. To fix this, try making sure your source table is a Delta table registered in Unity Catalog, and review your query to remove any complex logic or unsupported sources like external file reads (CSV, Parquet directly, etc.). Keeping the logic simple and based on Delta helps Databricks process only new or changed data. Let me know if you’d like help reviewing your query!
Regards,
Brahma