Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-15-2021 12:30 AM
AFAIK common spark does not have this num_affected_rows. I assume you execute delta lake actions.
You can fetch this from the json files stored in the _delta lake folder.
In those files there is a member called 'operationmetrics'.
https://databricks.com/discover/diving-into-delta-lake-talks/unpacking-transaction-log
Excellent video on how the delta lake transaction log works.