Hi all, I just joined this community today. I was wondering how have you guys encorporated Databricks into your organization or company and if there is a specific feature of Databricks that you now can't live without?
To my knowledge, Delta Lake tables should be consistent and support ACID transactions. In summary, each transaction is processed serially and each cluster will contain a snapshot of the Delta Lake table(s).See more info here: https://docs.databricks....
For Azure Databricks, having the high concurrency cluster selected might help your use case.More info: https://learn.microsoft.com/en-us/azure/databricks/archive/compute/configure