How can i read parquet file compressed by snappy?
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-03-2016 07:39 AM
Hi All,
I wanted to read parqet file compressed by snappy into Spark RDD
input file name is: part-m-00000.snappy.parquet
i have used sqlContext.setConf("spark.sql.parquet.compression.codec.", "snappy")
val inputRDD=sqlContext.parqetFile(args(0))
whenever im trying to run im facing java.lang.IlligelArgumentException : Illegel character in opaque part at index 2
i tried renaming the input file like input_data_snappy.parquet,then also im getting same exception.
please help me for this
Thanks for advance.
1 REPLY 1
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-05-2016 10:31 AM
Have you tried sqlContext.read.parquet("/filePath/") ?

