Databricks Community
Data Engineering
Re: Spark Optimization
Lakshay
Databricks Employee
Options
Mark as New
Bookmark
Subscribe
Mute
Subscribe to RSS Feed
Permalink
Print
Report Inappropriate Content
11-18-2024
09:05 AM
Have you tried using
spark.sql.files.maxPartitionBytes=209715200
