uzairm
Databricks Partner
Operations like collect() select() are done on driver node. All aggregations. Avoid those.