topic Why sometimes autoloader lose the checkpoint path and break the streaming? in Data Engineering

Why sometimes autoloader lose the checkpoint path and break the streaming?

ViktorWolf — Tue, 28 Jun 2022 22:18:07 GMT

Why sometimes autoloader lose the checkpoint path and break the streaming?

Re: Why sometimes autoloader lose the checkpoint path and break the streaming?

jose_gonzalez — Tue, 05 Jul 2022 18:36:20 GMT

Hi @Vittorio Antonacci,

Could you please provide more details on this issue? what path did you provide for your checkpoint? could you share some code snippet and the full error stack trace?

Re: Why sometimes autoloader lose the checkpoint path and break the streaming?

Hubert-Dudek — Mon, 11 Jul 2022 15:28:45 GMT

Some log messages could be useful. You can also register your stream as delta live table so it will be rebooted automatically.

Re: Why sometimes autoloader lose the checkpoint path and break the streaming?

Vidula — Sun, 28 Aug 2022 05:49:42 GMT

Hi @Vittorio Antonacci

Hope all is well! Just wanted to check in if you were able to resolve your issue, and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!