Databricks JDBC Driver Version 42 Limitations
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-22-2025 05:35 AM
We found that the Databricks JDBC driver does not support:
- Connection.setAutoCommit(false)
- Connection.commit()
- Connection.rollback()
- Execution of BEGIN TRANSACTION
Can you help us understand why these operations are not supported by the Databricks JDBC driver?
Is there an alternative JDBC driver for Databricks that supports the above-mentioned operations?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-23-2025 08:06 AM
As far as I know, the Databricks JDBC driver doesn’t support manual transaction controls like setAutoCommit(false), commit(), rollback(), or BEGIN TRANSACTION. That’s because Delta Lake are designed to support atomic operations at the single statement or table level, not multi-statement transactions like you’d find in traditional databases. The JDBC driver runs in auto-commit mode by default, so it doesn’t allow for manual transaction handling.
As of now, there isn’t another JDBC driver for Databricks that supports those manual transaction features. Instead, you can use operations like MERGE or INSERT OVERWRITE, which are atomic on their own. And if you ever need to roll back changes, Delta Lake’s Time Travel feature can help with that.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
05-26-2025 11:03 AM
Thank you, @SP_6721 , for your input!
Could you please share an example snippet demonstrating how to handle batch processing, similar to what we typically do in a relational database?