Thank you for sharing the detailed explanation. I was following the same approach, but the challenge was that with foreachBatch, SDP wasn’t able to reliably track whether the table had been created or not. When I tried Option 3 (without using the LIVE keyword in the Gold MV), it still failed to detect the Silver table.

As you mentioned, the only remaining option is to use two separate SDP pipelines instead of a single one. I have validated this approach, and it is working as expected.