cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is there any way we can use usermetadataAsOf option in time travelling query or can we modify the timestamps of delta lake that seems to be immutable?

Priyanka48
Contributor

We are using delta lake time travelling capability in our current project. We can use select * from timestamp/versionAsOF query. However ,there might be some change in our approach and we might need to recreate the delta lake while persisting the time travelling capability. We have checked the option of using usermetadata to persist original timestamps while recreating delta lake. however, it seems we can not use usermetdataAsOf option directly in time travelling query. Can we get the feature to modify the timestamps in delta table history or can we get an option to use usermetadataAsOf option ?

2 REPLIES 2

Debayan
Databricks Employee
Databricks Employee

Hi Priyanka, Thanks for reaching out to community.databricks.com.

As of now, "As of" query only has two parameters timestamp and version.

Please refer: https://docs.delta.io/latest/delta-batch.html#sql-as-of-syntax

Please let us know in case if you have any further queries on the same.

yes. So I asked if we can get usermetadata as of feature or can we edit the history of delta tables for e.g timestamp columns?

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now