- 1646 Views
- 4 replies
- 4 kudos
Photon engine throws error "JSON document exceeded maximum allowed size 400.0 MiB"
I am reading a 83MB json file using " spark.read.json(storage_path)", when I display the data is seems displaying fine, but when I try command line count, it complains about file size , being more than 400MB, which is not true.Photon JSON reader erro...
- 1646 Views
- 4 replies
- 4 kudos
Latest Reply
- 4 kudos
@Kamal Kumar​ :The error message suggests that the JSON document size is exceeding the maximum allowed size of 400MB. This could be caused by one or more documents in your JSON file being larger than this limit. It is not a bug, but a limitation set ...
- 4 kudos