Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-31-2025 04:15 AM
set following spark session properties and give a try:
'spark.databricks.delta.properties.defaults.autoOptimize.optimizeWrite': 'true'
'spark.databricks.delta.optimizeWrite.enabled': 'true'
'spark.sql.shuffle.partitions': 'auto'
