Why a new project instead of putting this in Apache Spark itself

User16826994223
Databricks Employee
Databricks Employee