smukhi
New Contributor II

@johnmacnamara unfortunately not, we're still using the "temporary" fix I described above where we just write out to S3 using `df.write.parquet` and then read the data back in.