Why does databricks need two IP addresses per node in a cluster

aladda
Databricks Employee
Databricks Employee
 

aladda
Databricks Employee
Databricks Employee

For an optimal processing experience Databricks segregates the Spark application traffic from the management traffic to avoid Network contention. Spark application traffic communications between the Driver-Executor and the Executors themselves where the computation if happening. Management traffic includes things such as communication between the Control Plane <-> Data Plane, etc