I have a large delta table that I need to analyze in native R. The only option I have currently is to query the delta table then use collect() to bring that spark dataframe into an R dataframe. Is there an alternative method that would allow me to query the delta lake directly into an R dataframe.
I found the following information on how to do this via Python using the Rust API but that is not compatible with R.
