topic Re: Can we use autoloader to stream files from delta tables(source) in Data Engineering

Can we use autoloader to stream files from delta tables(source)

Ashok1 — Mon, 13 Jun 2022 11:20:44 GMT

Re: Can we use autoloader to stream files from delta tables(source)

Anonymous — Thu, 14 Jul 2022 14:32:45 GMT

Autoloader is fuss-free way for incremental ingestion of raw data from object storage.

To run streaming jobs reading from Delta tables, I will recommend Delta Live Tables. DLT currently supports both Python or SQL, and it reduces a lot of complexity on infrastructure for your streaming jobs.

Re: Can we use autoloader to stream files from delta tables(source)

Anonymous — Thu, 18 Aug 2022 15:31:41 GMT

Hey there @Ashok ch

Hope everything is going great.

Does @Ivan Tang's response answer your question? If yes, would you be happy to mark it as best so that other members can find the solution more quickly? Else please let us know if you need more help.

We'd love to hear from you.

Thanks!