Re: Syncing lakebase table to delta table

AkhileshVB · ‎06-27-2025

I have been exploring Lakebase and I wanted to know if there is a way to sync CDC data from Lakebase tables to delta table in Lakehouse. I know the other way is possible and that's what was shown in the demo. Can you tell how I can I sync both the tables in real time or near real time? Is it something that databricks is going to release soon? If not can you guide me on how can I implement this thing.

P.S: For external Postgres, I know there are tools like Debezium with Kafka which does log based CDC to get the data into databricks.

sarahbhord · ‎10-08-2025

Hey AkhileshVB!

Lakebase-to-Delta CDC sync is in Private Preview—GA/Preview dates are not firm yet. Doo you have a Databricks contact or account manager? They are the right place to go if you want early involvement.

Workarounds & DIY Approaches:

For now, there’s no built-in, fully supported method for automated real-time Lakebase-to-Delta sync in the general product. However, you could implement custom CDC extraction using standard Postgres logical replication tools (e.g., Debezium, Kafka, or Arcion), and then write those captured changes into Delta tables. This is similar to how you’d extract CDC from an external Postgres. Note: This may require additional infrastructure and careful management of schemas and data integrity.

Implementation involves:

Setting up logical replication slots on Lakebase (if supported in your environment—check limitations!),
Using open-source or 3rd-party CDC tools (Debezium, Arcion, etc.),
Writing a consumer that ingests changes and applies them to Delta tables.

Hope this helps!

Best,

Sarah

View solution in original post

Malthe · ‎10-27-2025

Just wanted to mention that the ETL from Lakebase to Delta Tables preview is mentioned here:
https://www.databricks.com/blog/how-use-lakebase-transactional-data-layer-databricks-apps