Hi, You can read GZ files through spark.
https://stackoverflow.com/questions/42761912/how-to-read-gz-compressed-file-by-pyspark
Please let us know if this helps. Also, please tag @Debayan with your next comment so that I will get notified. Thank you!
