cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Is there any way we can use usermetadataAsOf option in time travelling query or can we modify the timestamps of delta lake that seems to be immutable?

Priyanka48
New Contributor III

We are using delta lake time travelling capability in our current project. We can use select * from timestamp/versionAsOF query. However ,there might be some change in our approach and we might need to recreate the delta lake while persisting the time travelling capability. We have checked the option of using usermetadata to persist original timestamps while recreating delta lake. however, it seems we can not use usermetdataAsOf option directly in time travelling query. Can we get the feature to modify the timestamps in delta table history or can we get an option to use usermetadataAsOf option ?

3 REPLIES 3

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi Priyanka, Thanks for reaching out to community.databricks.com.

As of now, "As of" query only has two parameters timestamp and version.

Please refer: https://docs.delta.io/latest/delta-batch.html#sql-as-of-syntax

Please let us know in case if you have any further queries on the same.

Priyanka48
New Contributor III

yes. So I asked if we can get usermetadata as of feature or can we edit the history of delta tables for e.g timestamp columns?

Kaniz
Community Manager
Community Manager

Hi @Priyanka Mane​ , We haven't heard from you on the last response from @Debayan Mukherjee​ , and I was checking back to see if his suggestions helped you.

Or else, If you have any solution, please share it with the community as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.