There are some approaches you can test:

• Delta Caching: Enable Delta caching to reduce the number of metadata queries. This can be done by setting the spark.databricks.io.cache.enabled configuration to true.
• Optimize Command: Use the OPTIMIZE command to compact small files into larger ones, which can reduce the number of metadata operations.
• Z-Ordering: Apply Z-Ordering to your Delta tables to optimize the layout of data, which can help reduce the number of metadata queries during read operations.