cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Loading parquet files with earlier timestamp looking for newer files

mihirkum123
New Contributor

I have a setup where i am replicating Delta live tables parquet, and checkpoint files using azure RAGZRS to peer region for disaster recovery. When i load the the replicated files in peer region using delta format, i get an error that _delta_log/000000000000000_x.json not found. I am loading as of 48 hours in past so i know that all the files before that is replicated. Moreover, x is the of most recent JSON file number which is supposed to be replicated from primary. I tried using timestamp as of,  and version as of and both result in same error. Error disappears as soon as the JSON file is replicated from primary. Is this expected behavior? I would imagine that if i am loading from past, i will not see this error. 

0 REPLIES 0

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local communityโ€”sign up today to get started!

Sign Up Now