Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-10-2024 07:20 AM
Sorry for getting back to you late.
I tried using StringType for col10, but unfortunately, it didn't work due to an error:
"Failed to merge incompatible data types BooleanType and StringType."
However, I've found that by setting the pipelines.reset.allowed option to false in the DLT table, I'm able to process the downstream (silver) table without data loss.
Additionally, applying this setting to the bronze table allows for a full refresh without any data loss.
If you're interested in this feature, I highly recommend exploring it further.
Thanks a lot!