Execute COPY INTO query with source as temp view
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-23-2023 02:04 AM
We are having the files that needs to be loaded into the delta table
Now we want to perform some transformation on the files and load that into the table
What we did
- Create a Spark DF from that file
- Apply transformation on the DF
- Create a temp view from the DF
- Load the temp view using COPY INTO query as source
Will that be possible to use COPY Query in such a way ?
Labels:
- Labels:
-
Tempview
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-23-2023 06:35 AM
Hi @Sravan Kumar Mohanraj ,
Yes, you can use copy query in this case your temp_view will be source.
For more info, please visit these links.
Ajay Kumar Pandey