Lot of write shuffle on optimize + ZORDER, is it normal?

alejandrofm
Valued Contributor

Hi! I'm optimizing several Tb of partitioned data on ZSTD lvl 9.

It surprises me the level of shuffle write, it could make sense because of ZORDER but I want to be sure that I'm not missing something, here is some context:image 

image.pngCould I be missing something or is this the expected behavior?

Thanks!

----Edit----

Also a lot of computation in "locality" = ANY

image