topic Re: Does Delta Live Tables only work with Delta tables? in Data Engineering

Does Delta Live Tables only work with Delta tables?

Ryan_Chynoweth — Fri, 25 Jun 2021 22:05:29 GMT

Re: Does Delta Live Tables only work with Delta tables?

Ryan_Chynoweth — Fri, 25 Jun 2021 22:05:41 GMT

Yes, Delta Live Tables can only be used to update Delta tables.

Re: Does Delta Live Tables only work with Delta tables?

Trodenn — Thu, 22 Dec 2022 04:32:34 GMT

is there a way to read a delta live table and then have it as a spark dataframe?

Re: Does Delta Live Tables only work with Delta tables?

Ryan_Chynoweth — Thu, 22 Dec 2022 19:03:25 GMT

Hi @Pierre Nanquette ,

You cannot use dataframes within a DLT pipeline. However, tables that are created in a pipeline are saved to target databases at which point you can read those tables into dataframes using Scala/Python/R outside of your DLT notebook.

TLDR - create a new notebook and read the data with dataframes.

Does that help?