Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-06-2024 02:30 PM
I disabled auto optimize in my notebook but still there is auto optimize running when I query describe history {tablename}. I have used the following settings for setting it to false:
spark.conf.set('spark.databricks.delta.properties.defaults.autoOptimize.optimizeWrite', 'false')
spark.conf.set('spark.databricks.delta.properties.defaults.autoOptimize.autoCompact', 'false')
spark.conf.set('spark.databricks.delta.optimizeWrite.enabled', 'false')
SET TBLPROPERTIES ('autoOptimize' = 'false', 'targetFileSize' = '16mb', 'optimizeWrite' = 'false', 'autoCompact' = 'false')
