cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Is there any way we can use usermetadataAsOf option in time travelling query or can we modify the timestamps of delta lake that seems to be immutable?

Priyanka48
Contributor

We are using delta lake time travelling capability in our current project. We can use select * from timestamp/versionAsOF query. However ,there might be some change in our approach and we might need to recreate the delta lake while persisting the time travelling capability. We have checked the option of using usermetadata to persist original timestamps while recreating delta lake. however, it seems we can not use usermetdataAsOf option directly in time travelling query. Can we get the feature to modify the timestamps in delta table history or can we get an option to use usermetadataAsOf option ?

3 REPLIES 3

Debayan
Esteemed Contributor III
Esteemed Contributor III

Hi Priyanka, Thanks for reaching out to community.databricks.com.

As of now, "As of" query only has two parameters timestamp and version.

Please refer: https://docs.delta.io/latest/delta-batch.html#sql-as-of-syntax

Please let us know in case if you have any further queries on the same.

yes. So I asked if we can get usermetadata as of feature or can we edit the history of delta tables for e.g timestamp columns?

Kaniz_Fatma
Community Manager
Community Manager

Hi @Priyanka Mane​ , We haven't heard from you on the last response from @Debayan Mukherjee​ , and I was checking back to see if his suggestions helped you.

Or else, If you have any solution, please share it with the community as it can be helpful to others.

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group