Tips for resolving follolwing errors related to AWS S3 read / write

[Vee]

Job aborted due to stage failure: Task 0 in stage 3084.0 failed 4 times, most recent failure: Lost task 0.3 in stage 3084.0 (TID...., ip..., executor 0): org.apache.spark.SparkExecution: Task failed while writing rows

Job aborted due to stage failure: Task 0 in stage 3078.0 failed 4 times, most recent failure: Lost task 0.3 in stage 3078.0 (TID...., ip..., executor 0): java.io.interruptedExecution: getFileStatus on s3:<file path> : com.amazonaws.SdkClientException: Unable to execute HTTP request. Timeout waiting for connection from pool

[Kaniz_Fatma]

Hi @Vetrivel Senthil​ , Would you mind pasting the code stack here?

[jose_gonzalez]

Hi @Vetrivel Senthil​ ,

Just a friendly follow-up. Could you copy and paste the full error stack trace from your driver logs here? we might need the full error with the "cause" if possible. Thank you in advance.

[Kaniz_Fatma]

Hi @Vetrivel Senthil​ , Are you still facing the problem? Were you able to resolve it by yourself, or do you still need help? Please let us know.