As part of my ETL process, I create intermediate/staging temporary tables. These tables created are read at a later point in the ETL and finally cleaned up. Should I use Delta? Using Delta creates the overhead of running optimize jobs, which would delay my ETL. Enabling optimize writes also will add delay to my ETL
What is the best practice/recommendation here.