Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-05-2023 10:58 PM
@Rajesh Akshith
Delta is ACID complaint, so writing to the same file parallelly may cause a failure.
https://docs.databricks.com/lakehouse/acid.html#how-does-databricks-implement-consistency
About how you can handle this situation, it depends on the use case.
I would suggest to partition the data, so the parallel processes would r/w to the different files.