jose_gonzalez
Databricks Employee
Databricks Employee

Hi @nafri A​ ,

I don't think there is a solution to merge the files before readying them in Spark. Like @Werner Stinckens​ said, you will need to read all the files and saved them as Delta lake. Once all the files are written as Delta lake, then you can do optimized to compact the files.

View solution in original post