topic Snowflake query with time travel not working from Databricks while reading into Dataframe. in Data Engineering

Snowflake query with time travel not working from Databricks while reading into Dataframe.

Skv — Thu, 11 May 2023 07:07:04 GMT

I am trying to read the changes data from snowflake query into the dataframe using Databricks.

Same query is working in snowflake but not in Databricks. Both sides timezones and format are same for the timestamp. I am trying to implement changetracking feature from below query. No problem in snowflake but in databricks issue is coming.

Below is my query and error.

SELECT * FROM TestTable CHANGES(INFORMATION => DEFAULT) AT(TIMESTAMP => '2023-05-03 00:43:34.885 -7000')

Error:

Time travel data is not available for table TestTable. The requested time is either beyond the allowed time travel period or before the object creation time.

Please help.

Re: Snowflake query with time travel not working from Databricks while reading into Dataframe.

karthik_p — Fri, 12 May 2023 17:33:26 GMT

@SkvAdi v based on error it looks time provided seems to in correct, provided time stamp might be before object created date time. can you please check when table created and provide and test

Re: Snowflake query with time travel not working from Databricks while reading into Dataframe.

sher — Fri, 23 Jun 2023 15:18:29 GMT

you are format is wrong that's why you got an error

try this

SELECT * FROM TestTable CHANGES(INFORMATION => DEFAULT)

AT(TIMESTAMP => TO_TIMESTAMP_TZ('2023-05-03 00:43:34.885','YYYY-MM-DD HH24:MI:SS.FF'))