https://community.databricks.com/t5/data-engineering/natively-query-delta-lake-with-r/m-p/17180#M11222 <P>I have a large delta table that I need to analyze in native R. The only option I have currently is to query the delta table then use collect() to bring that spark dataframe into an R dataframe. Is there an alternative method that would allow me to query the delta lake directly into an R dataframe.</P><P></P><P>I found the following information on how to do this via <A href="https://www.databricks.com/blog/2020/12/22/natively-query-your-delta-lake-with-scala-java-and-python.html?_ga=2.122240654.401942897.1670885579-1072108147.1590499586" alt="https://www.databricks.com/blog/2020/12/22/natively-query-your-delta-lake-with-scala-java-and-python.html?_ga=2.122240654.401942897.1670885579-1072108147.1590499586" target="_blank">Python using the Rust API</A> but that is not compatible with R.</P> Mon, 12 Dec 2022 23:18:35 GMT Dave_Nithio 2022-12-12T23:18:35Z https://community.databricks.com/t5/data-engineering/natively-query-delta-lake-with-r/m-p/17180#M11222 <P>I have a large delta table that I need to analyze in native R. The only option I have currently is to query the delta table then use collect() to bring that spark dataframe into an R dataframe. Is there an alternative method that would allow me to query the delta lake directly into an R dataframe.</P><P></P><P>I found the following information on how to do this via <A href="https://www.databricks.com/blog/2020/12/22/natively-query-your-delta-lake-with-scala-java-and-python.html?_ga=2.122240654.401942897.1670885579-1072108147.1590499586" alt="https://www.databricks.com/blog/2020/12/22/natively-query-your-delta-lake-with-scala-java-and-python.html?_ga=2.122240654.401942897.1670885579-1072108147.1590499586" target="_blank">Python using the Rust API</A> but that is not compatible with R.</P> Mon, 12 Dec 2022 23:18:35 GMT https://community.databricks.com/t5/data-engineering/natively-query-delta-lake-with-r/m-p/17180#M11222 Dave_Nithio 2022-12-12T23:18:35Z