Databricks Community

RohanB · 01-27-2022

I have a Spark Structured Streaming job which reads from 2 Delta tables in streams , processes the data and then writes to a 3rd Delta table. The job is being run with the Databricks service on GCP.Sometimes the job fails with the following exception...

RohanB · 02-16-2022

Hi @Jose Gonzalez ,Yes, it is referring to the GCP storage.Thanks and Regards,Rohan

RohanB · 02-15-2022

Hi @Jose Gonzalez ,Do you require any more information regarding the code? Any idea what could be cause for the issue?Thanks and Regards,Rohan

RohanB · 02-08-2022

Hi @Jose Gonzalez ,Thanks for the reply. Write stream is as followsdataset.writeStream .format("delta") .outputMode("append") .option("checkpointLocation", "dbfs:/checkpoints_v1/<table_name>") ...

Databricks Community

User Stats

User Activity

Spark Streaming - Checkpoint State EOF Exception

Re: Spark Streaming - Checkpoint State EOF Exception

Re: Spark Streaming - Checkpoint State EOF Exception

Re: Spark Streaming - Checkpoint State EOF Exception