Is it possible to have multiple DLT pipelines write data concurrently and in append mode to the same Delta table? Because of different data sources, with different data volumes and required processing, we would like to have different pipelines streaming from the aforementioned data sources.
We tried setting the "pipelines.tableManagedByMultiplePipelinesCheck.enabled" pipeline configuration to "false" and we managed to stream data to the same target from two different pipelines. However, this configuration option could result in unexpected behavior. Could you please elaborate on this "unexpected bahavior"? What could we expect if multiple pipelines stream data to the same Delta table while having the "pipelines.tableManagedByMultiplePipelinesCheck.enabled" pipeline configuration set to "false"?
