It's a simple answer bro. According to our analysis Azure pipelines and not books match process approximately 40% faster than the snaps analytics. If we really want to optimise your pipelines and perform cost optimisations in your team please migrate to the databricks. Databrics team support you on every stage but they will charge you it's a bit apart from the post. Try to hire experience databricks guy .or it is better to go blindinly with the databricks team.