Hi,

have You tried changing the checkpoint location path?

I used that below syntax previously and it worked fine for me:

stream = (
    df.writeStream
    .format("delta")
    .trigger(availableNow=True)
    .option("checkpointLocation", checkpoint_location)
    .foreachBatch(...)
    .start()
)