Databricks Community

Sri1 · 04-08-2016

Hi, My requirement is I need to create a Spark In-memory table (Not pushing hive table into memory) insert data into it and finally write that back to Hive table. Idea here is to avoid the disk IO while writing into Target Hive table. There are lot ...

Sri1 · 04-12-2016

Vida, Thank you very much for your help That works good but problem is I have to insert data from multiple queries. I have to declare collection of dataframes to store data from each query at the end I can union all dataframes and insert into an Hiv...

Sri1 · 04-11-2016

Hi Vida, Sorry for the late reply. I tried creating 2 similar temp tables in spark based on a Hive table, 1 had data other one is empty when I try to insert into empty table I get the below error org.apache.spark.sql.AnalysisException: Inserting int...

Databricks Community

User Stats

User Activity

Create a in-memory table in Spark and insert data into it

Re: Create a in-memory table in Spark and insert data into it

Re: Create a in-memory table in Spark and insert data into it