Hey AkhileshVB!
Lakebase-to-Delta CDC sync is in Private Preview—GA/Preview dates are not firm yet. Doo you have a Databricks contact or account manager? They are the right place to go if you want early involvement.
Workarounds & DIY Approaches:
For now, there’s no built-in, fully supported method for automated real-time Lakebase-to-Delta sync in the general product. However, you could implement custom CDC extraction using standard Postgres logical replication tools (e.g., Debezium, Kafka, or Arcion), and then write those captured changes into Delta tables. This is similar to how you’d extract CDC from an external Postgres. Note: This may require additional infrastructure and careful management of schemas and data integrity.
Implementation involves:
- Setting up logical replication slots on Lakebase (if supported in your environment—check limitations!),
- Using open-source or 3rd-party CDC tools (Debezium, Arcion, etc.),
- Writing a consumer that ingests changes and applies them to Delta tables.
Hope this helps!
Best,
Sarah