jose_gonzalez
Databricks Employee
Databricks Employee

just wondering where the magic number "768" in your repartition is coming from? how big is your cluster? what about your driver instance?