- 13582 Views
- 3 replies
- 7 kudos
Resolved! How to set retention period for a delta table lower than the default period? Is it even possible?
I am trying to set retention period for a delta by using following commands.deltaTable = DeltaTable.forPath(spark,delta_path)spark.conf.set("spark.databricks.delta.retentionDurationCheck.enabled", "false")deltaTable.logRetentionDuration = "interval 1...
- 13582 Views
- 3 replies
- 7 kudos
Latest Reply
- 7 kudos
There are two ways:1) Please set in cluster (Clusters -> edit -> Spark -> Spark config):spark.databricks.delta.retentionDurationCheck.enabled false 2) or just before DeltaTable.forPath set (I think you need to change order in your code):spark.conf.se...
- 7 kudos