VaderK

- - Certifications
- - Learning Paths
- - Databricks Product Tours
- - Get Started Guides

- - Get Started Resources
- - Events
- - Support FAQs
- - Technical Blog
- - Community Articles
- - Announcements
- - DatabricksTV
- - Product Platform Updates

- - Private Groups
  - Princeton Life Sciences Databricks User Group
- - Skills@Scale

- - Databricks Community Innovators
- - Khoros Community Forums Support (Not for Databricks Product Questions)
- - Databricks Community Code of Conduct

New Contributor

since

‎04-17-2025

User Stats

1 Posts
0 Solutions
1 Kudos given
0 Kudos received

Why does .collect() cause a shuffle while .show() does not?

04-08-2025

I’m learning Spark using the book Spark: The Definitive Guide and came across some behavior I’m trying to understand.I am reading a csv_file which has 3 columns: DEST_COUNTRY_NAME, ORIGIN_COUNTRY_NAME, count. The dataset has a total of 256 rows.Here’...

Kudos given to

User

Count

Databricks Community

User Stats

User Activity

Why does .collect() cause a shuffle while .show() does not?