cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Execute COPY INTO query with source as temp view

HappySK
New Contributor

We are having the files that needs to be loaded into the delta table

Now we want to perform some transformation on the files and load that into the table

What we did

  1. Create a Spark DF from that file
  2. Apply transformation on the DF
  3. Create a temp view from the DF
  4. Load the temp view using COPY INTO query as source

Will that be possible to use COPY Query in such a way ?

1 REPLY 1

Ajay-Pandey
Esteemed Contributor III

Hi @Sravan Kumar Mohanraj​ ,

Yes, you can use copy query in this case your temp_view will be source.

For more info, please visit these links.

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.