lprevost
Contributor III

Are the json files compressed?  If they are in .gz, this is unsplittable which means you lose some of spark's parallel magic.