This is happening because the delta/parquet source has one or more of the following:

1. a huge number of columns
2. huge strings in one or more columns
3. huge arrays/map, possibly nested in each other

In order to mitigate this issue, could you please reduce spark.sql.parquet.columnarReaderBatchSize from default value - 4096 ?