Hi,

My requirement is I need to create a Spark In-memory table (Not pushing hive table into memory) insert data into it and finally write that back to Hive table.

Idea here is to avoid the disk IO while writing into Target Hive table. There are lot of insert statements but I want to write that back to Hive table only after all execution is over.

Could you please let me know if that is possible. Please let me know if you have better solution

Thanks & Regards,

~Sri