Databricks introduces multi-table transactions, allowing operations across multiple Delta tables to execute as a single atomic unit. Delta Lake has provided ACID guarantees at the table level, but ensuring atomicity across multiple tables previously required manual coordination leading to errors, partial updates and operational complexity.
With Unity Catalog & catalog managed tables, organizations can group multiple data manipulation operations inside a block and execute it as an All or Nothing single unit bringing excellent capabilities to the Lakehouse. All changes succeed or rolled back
The tables must be Unity Catalog Delta or Iceberg with delta feature catalog Managed supported running on supported clusters.
Below are the two modes:
INTERACTIVE TRANSACTIONS MODE - In interactive mode, a user or application controls commit/rollback based on iterative logic. Apply COMMIT or ROLLBACK based on the validation outcomes.
NON INTERACTIVE ATOMIC MODE - Suited for scheduled jobs
SIGNAL - Use SIGNAL in the blocks to fail the transaction when a defined condition is not met. Signal is useful for doing data validations before committing
Transactions bring strong atomicity to the Lakehouse. Its either all data committed or nothing. No partial updates.
While this is a powerful capability, it introduces additional coordination overhead. Keep transactions short, use only the required tables to maintain performance.
