Hi,
I am getting FilereadException Error while reading JSON file using REST API Connector.
It comes when data is huge in Json File and it's not able to handle more than 1 Lac records.
Error details:
org.apache.spark.SparkException: Job aborted due to stage failure: Task 45 in stage 42917.0 failed 4 times,
most recent failure: Lost task 45.3 in stage 42917.0 (TID 246862) (10.22.49.200 executor 18):
com.databricks.sql.io.FileReadException: Error while reading file
dbfs:/mnt/data/raw/Test_RESTAPI.json.
Py4JJavaError: An error occurred while calling o13842.json.
Please help.
Thanks