Hi Tyler,

Thanks for the quick response. That was going to be next approach as well. I had also come across the article you refer to, however, we are currently using "plain" pyspark in Notebooks and not delta live tables, so I am not sure it can be directly used, but I am certain I can get some inspiration.

 Thank you.