Getting Executor lost due to stage failure error on writing data frame to a delta table or any file like parquet or csv or avro

[konda1]

We are working on multiline nested ( multilevel).

The file is read and flattened using pyspark and the data frame is showing data using display() method. when saving the same dataframe it is giving executor lost failure error.

for some files it is giving the executor lost failure dueto heat beat while reading the files itself.

if any of you encountered the same kind of issue, or know the solution, please do help