@Ashwin_DSA 
Thanks for the documentation. It will help understand DLT better, and improve our code.

For this special case, when I set "pipeline compute" to None, all the problems disappeared. 
As to the flatten array function, it is being used by several other pipelines in production. Regardless, the document will help make it better.