Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-30-2023 01:26 AM
from the screenshot you provided it seems you are doing a merge statement.
Depending on the partitioning of your delta table this can be done in parallel or not.
f.e. if all your incoming data resides in one huge partition, spark will have to completely write this huge partition which can take a long time.
Can you share some code?