Folks , when I want to push data to snowflake I need to use a stage for files before copying data over. However, when I utilise the net.snowflake.spark.snowflake.Utils library and do a spark.write as in...
spark.read.format("csv")
.option("header", "true")
.load("/mydata.data")
.write.format("snowflake")
.options(options).mode("append").option("dbtable", "mytable").save()
I can write directly into snowflake without specifying a stage etc.
Just wondering how this works so I can preempt any security problems etc.
