We are having the files that needs to be loaded into the delta table
Now we want to perform some transformation on the files and load that into the table
What we did
- Create a Spark DF from that file
- Apply transformation on the DF
- Create a temp view from the DF
- Load the temp view using COPY INTO query as source
Will that be possible to use COPY Query in such a way ?