Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-02-2025 02:11 AM
Thanks for your response. But we did not find any documentation for @dlt.create_or_refresh_streaming_table decorator.
However we create many tables dynamically using dlt.create_streaming_table(name=table_name) which I doubt would be supported by the decorator.
Surely we tried dropping the tables first. But if we drop the table and run the pipeline again, we receive another error:
java.lang.IllegalStateException: Soft-deleted MV/STs that require changes cannot be undropped directly. If you need to update the target schema of the pipeline or modify the visibility of an MV/ST while also undropping it, please invoke the undrop operation with the original schema and visibility in an update first, before applying the changes in a subsequent update.
Hope you can help us further.
