How can i read parquet file compressed by snappy?

Mallesh — Wed, 03 Aug 2016 14:39:41 GMT

Hi All,

I wanted to read parqet file compressed by snappy into Spark RDD

input file name is: part-m-00000.snappy.parquet

i have used sqlContext.setConf("spark.sql.parquet.compression.codec.", "snappy")

val inputRDD=sqlContext.parqetFile(args(0))

whenever im trying to run im facing java.lang.IlligelArgumentException : Illegel character in opaque part at index 2

i tried renaming the input file like input_data_snappy.parquet,then also im getting same exception.

please help me for this

Thanks for advance.

Re: How can i read parquet file compressed by snappy?

raela — Fri, 05 Aug 2016 17:31:51 GMT

Have you tried sqlContext.read.parquet("/filePath/") ?