Vinay_M_R
Databricks Employee
Databricks Employee

Hi @erigaud  Good day!

Whenever you are saving the data, you could pass the parquet.block.size config as an option:

Example:

spark.read.parquet("dbfs:/delta/delta-path/part-xxxx.snappy.parquet").write.mode("overwrite").option("parquet.block.size", 500).parquet("/tmp/vinay/parquet/blocksize1")