- 2395 Views
- 1 replies
- 0 kudos
Does spark utilise a temporary stage when writing to snowflake? How does that work?
Folks , when I want to push data to snowflake I need to use a stage for files before copying data over. However, when I utilise the net.snowflake.spark.snowflake.Utils library and do a spark.write as in...spark.read.format("csv") .option("header", ...
- 2395 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Yes it uses a temporary stage. should have just looked in snowflake history
- 0 kudos
- 15959 Views
- 2 replies
- 3 kudos
- 15959 Views
- 2 replies
- 3 kudos
Latest Reply
- 3 kudos
@Direo Direo​ , Yeah, this is a location inside your dbfs. The whole control is on you. Databricks do not delete something you keep in this location.
- 3 kudos