Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-27-2026 06:53 AM
Hi @FAHADURREHMAN ,
In order to improve performance of the Materialized View:
- First, land parquet files into a Streaming Table. Use Auto Loader for incremental ingestion:
CREATE OR REFRESH STREAMING TABLE raw AS SELECT * FROM STREAM read_files(s3_path, format => 'parquet'); - Use this Streaming Table as a source of the Materialized View.
- The Materialized View will get incrementally refreshed, meaning that the joins and aggregations will be recalculated for the newly ingested rows only.
Prerequisites for incremental refresh:- Pipeline should run on Serverless
- The Materialized View should have eligible operators only
With this setup, you make sure the pipeline runs as fast as possible by minimal recomputations.
Hope it helps.
Best regards,