@Hanan Shteingart​ : We suggest you to use Delta Lake's OPTIMIZE command. Delta Lake's OPTIMIZE command can help improve query performance by reorganizing the table's data files and statistics. The OPTIMIZE command can automatically determine the best way to organize the table's data files based on your query patterns, and can help eliminate data skew and improve data locality.

Use Delta Lake's CLUSTER BY command: If you are unable to partition your table on the key

column due to a large number of unique values, you can use Delta Lake's CLUSTER BY command instead.