labtech
Valued Contributor II

Which size of parquet file, if is too small you can try with pandas then compare to pyspark