- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ09-08-2023 06:44 AM - edited โ09-08-2023 07:14 AM
ConcurrentAppendException requires a good partitioning strategy, here my logic works without fault for
- Labels:
-
Delta Lake
Accepted Solutions
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ09-11-2023 01:09 AM
https://docs.databricks.com/en/delta/merge.html
"By definition, whenNotMatchedBySource clauses do not have a source row to pull column values from, and so source columns canโt be referenced."
I found out that this was not functioning correctly in runtime 12.2 but works in 13.3.
So it must have been a fix in the Delta Lake version
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
โ09-11-2023 01:09 AM
https://docs.databricks.com/en/delta/merge.html
"By definition, whenNotMatchedBySource clauses do not have a source row to pull column values from, and so source columns canโt be referenced."
I found out that this was not functioning correctly in runtime 12.2 but works in 13.3.
So it must have been a fix in the Delta Lake version