@kali.tummala@gmail.com in general though the answers you want are too complicated to be explained in a forum post, do you have a point of contact at Databricks that you could setup time with? If not, you can reach out to me at fish@databricks.com