Designing Reliable Data Versioning Strategies in Databricks

Raj_DB
Contributor

Hi everyone,

I’m working on a use case where I need to retain 30 days of historical data in a Delta table and use it to build trend reports.

I’m looking for the best approach to reliably maintain this historical data while also making it suitable for reporting. I explored the Delta Lake time travel feature, but it currently only allows access to about 7 days of history, which doesn’t meet my requirement.

What would be the recommended way to handle this scenario?

Thank you!