Showing results for 
Search instead for 
Did you mean: 
New Contributor III
since ‎07-21-2022

User Stats

  • 3 Posts
  • 0 Solutions
  • 0 Kudos given
  • 5 Kudos received

User Activity

Hi Team,I am trying to run a streaming job in databricks, used Autoloader approach for reading the files from the Azure Datalake Gen2 which is in parquet format. I have created a new checkpoint, so first offset is getting created but throwing an erro...
We do not want to process all the old files, we only wanted to process latest files. whenever we use the new checkpoint path in another databricks workspace, streaming job is processing all the old files as well. Without autoloader feature, is there ...