532664
New Contributor III

@jcozar 

Sorry for getting back to you late.

I tried using StringType for col10, but unfortunately, it didn't work due to an error:

"Failed to merge incompatible data types BooleanType and StringType."

However, I've found that by setting the pipelines.reset.allowed option to false in the DLT table, I'm able to process the downstream (silver) table without data loss.

Additionally, applying this setting to the bronze table allows for a full refresh without any data loss.

If you're interested in this feature, I highly recommend exploring it further.

Thanks a lot!