Hi all,

I am new to Databricks and delta table. Recently I am researching on data archiving as we have data retention policy within the company.

I have studied the documentation (Archival support in Databricks | Databricks on AWS) and I am exploring the feasibility of applying such feature to my case.

Let say I have a requirement to archive the data after 5 years and all of the table are delta tables, I would like to ask the following questions:

1. How should I configure in Databricks?

2. Can I specify a datetime column in the table as archive reference duration? Or it simply count the duration from the time the record being inserted to the table?

3. Is there any difference in terms of archiving between managed table and external table?

3. Is there any difference in implementation if the environment is UC enabled?

4. As per my understanding, if we enable archive support but do not configure any lifecycle management on storage side (we are using Azure storage account), there is no cost saving on storage side as Databricks simply ignore the data and the underlining storage remains unchanged. May I know how we can configure lifecycle management on Azure storage account so it can algin with the archival support setting on Databricks side?

Highly appreciate if someone can help me with the above questions. Thanks in advance.