Hi all,

I asked to Gemini, who said:
"In general, PySpark is designed to handle large volumes of data and complex processing efficiently. However, sequentially running a large number of requests can lead to performance degradation if the cluster resources are not sized properly or if the requests are not optimized."

Let's say that our queries are fully optimized, there would be then only the point on cluster resources.
But I would prefer to have a human opinion... 🙂