How to solve column header issues in Spark SQL data frame
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-24-2017 05:52 AM
My code :
val name = sc.textFile("/FileStore/tables/employeenames.csv")
case class x(ID:String,Employee_name:String)
val namePairRDD = name.map(_.split(",")).map(x => (x(0), x(1).trim.toString)).toDF("ID", "Employee_name")
namePairRDD.createOrReplaceTempView("namePairRDD")
val df = sqlContext.sql("SELECT * FROM namePairRDD ")
df.show()
I dont know how ID and Employee_name shows up in the first row.
I tried appending the table by making column as headers, that dint work.
Please help.
Labels:
- Labels:
-
Spark sql