Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-21-2025 12:35 AM
Hey @vignesh22 - Adding to what @Takuya-Omi san has mentioned - the instantiation of streaming table in your definition is incorrect. You're trying to create a stream table using a batch source which will result in the DLT Analysis Exception as described below.
com.databricks.pipelines.common.errors.DLTAnalysisException: Creating a streaming table from a batch query prevents incremental loading of new data from source. Offending table: 'dev.default.test_table'.
Please use the stream() operator. Example usage:
CREATE STREAMING TABLE <target table name> ... AS SELECT ... FROM stream(<source table name>) ...If you're only trying to test the functionality of DLT, may be create a materialized view rather than the streaming table.
https://docs.databricks.com/aws/en/sql/language-manual/sql-ref-syntax-ddl-create-materialized-view
Let me know if any questions! Cheers!
Riz