What are the reasons behind Databricks going for their own driver? What differences are made when switching between the previous Spark driver and the new Databricks driver?

Is there any specific document I can look at or just the release notes?

Also, what is the reason behind the missing Installation and Configuration guide in the docs folder? The previous driver had one.