cancel
Showing results for 
Search instead for 
Did you mean: 
Administration & Architecture
Explore discussions on Databricks administration, deployment strategies, and architectural best practices. Connect with administrators and architects to optimize your Databricks environment for performance, scalability, and security.
cancel
Showing results for 
Search instead for 
Did you mean: 

Retention for hive_metastore tables

mattiags
New Contributor II

Hi

I have a notebook that creates tables in the hive_metastore with the following code:

 

df.write.format("delta").mode("overwrite").saveAsTable(output_table_name)
 
Which is the retantion for the data saved in the hive metastore? is there any configuration for keeping the data for like 5 years?
1 ACCEPTED SOLUTION

Accepted Solutions

Stefan-Koch
Contributor III

Hi mattiags

As long as you do not delete the data via notebook or in the data lake, it will not be deleted in any other way. This means that there is no retention time in this sense, or conversely, it is infinite until you deliberately delete the data.

View solution in original post

1 REPLY 1

Stefan-Koch
Contributor III

Hi mattiags

As long as you do not delete the data via notebook or in the data lake, it will not be deleted in any other way. This means that there is no retention time in this sense, or conversely, it is infinite until you deliberately delete the data.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group