Hey AkhileshVB!
Lakebase-to-Delta CDC sync is in Private PreviewโGA/Preview dates are not firm yet. Doo you have a Databricks contact or account manager? They are the right place to go if you want early involvement.
Workarounds & DIY Approaches:
For now, thereโs no built-in, fully supported method for automated real-time Lakebase-to-Delta sync in the general product. However, you could implement custom CDC extraction using standard Postgres logical replication tools (e.g., Debezium, Kafka, or Arcion), and then write those captured changes into Delta tables. This is similar to how youโd extract CDC from an external Postgres. Note: This may require additional infrastructure and careful management of schemas and data integrity.
Implementation involves:
- Setting up logical replication slots on Lakebase (if supported in your environmentโcheck limitations!),
- Using open-source or 3rd-party CDC tools (Debezium, Arcion, etc.),
- Writing a consumer that ingests changes and applies them to Delta tables.
Hope this helps!
Best,
Sarah