It helps :). Thank you.

I have two questions to clarify and possibly optimize.

1) Since I write the data frame to a table later, I'm wondering if there is again a full evaluation of the DataFrame. Consequently, there are two full evaluations, one triggered by 

df.write.format("noop").mode("overwrite").save()

and another one by writing to the table. Is that correct?

2) Does writing to table trigger a full evaluation of a data frame?

I use the following command for writing:

df.write.format("delta").option("optimizeWrite", "true").mode(
        "overwrite"
    ).saveAsTable("table_a")

I could rewrite the control flow to first write data frame to a table and then use the written bad records.