cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Execute COPY INTO query with source as temp view

HappySK
New Contributor

We are having the files that needs to be loaded into the delta table

Now we want to perform some transformation on the files and load that into the table

What we did

  1. Create a Spark DF from that file
  2. Apply transformation on the DF
  3. Create a temp view from the DF
  4. Load the temp view using COPY INTO query as source

Will that be possible to use COPY Query in such a way ?

1 REPLY 1

Ajay-Pandey
Esteemed Contributor III

Hi @Sravan Kumar Mohanrajโ€‹ ,

Yes, you can use copy query in this case your temp_view will be source.

For more info, please visit these links.

Ajay Kumar Pandey

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group