<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Data ingestion: Setting up a connector for Postgres with CDC enabled. in Data Engineering</title>
    <link>https://community.databricks.com/t5/data-engineering/data-ingestion-setting-up-a-connector-for-postgres-with-cdc/m-p/169117#M56042</link>
    <description>&lt;P&gt;Hello,&lt;BR /&gt;I'm trying to ingest data from my RDS instance and set up change data capture on Databricks. Everything on the Postgres side has been done so that replication is possible, but CDC is still greyed out. I have asked Claude, Gemini, and ChatGPT. I haven't got any concrete help. I read that it's an issue of Databricks needing to enable Lakeflow Connect for Postgres or something like.&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Wola_0-1789753526825.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/31291i14A36CC3F04565B3/image-size/medium?v=v2&amp;amp;px=400" role="button" title="Wola_0-1789753526825.png" alt="Wola_0-1789753526825.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;P.S.: I might not have explained it well, but I really need help with it.&lt;/P&gt;</description>
    <pubDate>Fri, 18 Sep 2026 17:49:31 GMT</pubDate>
    <dc:creator>Wola</dc:creator>
    <dc:date>2026-09-18T17:49:31Z</dc:date>
    <item>
      <title>Data ingestion: Setting up a connector for Postgres with CDC enabled.</title>
      <link>https://community.databricks.com/t5/data-engineering/data-ingestion-setting-up-a-connector-for-postgres-with-cdc/m-p/169117#M56042</link>
      <description>&lt;P&gt;Hello,&lt;BR /&gt;I'm trying to ingest data from my RDS instance and set up change data capture on Databricks. Everything on the Postgres side has been done so that replication is possible, but CDC is still greyed out. I have asked Claude, Gemini, and ChatGPT. I haven't got any concrete help. I read that it's an issue of Databricks needing to enable Lakeflow Connect for Postgres or something like.&lt;/P&gt;&lt;P&gt;&lt;span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Wola_0-1789753526825.png" style="width: 400px;"&gt;&lt;img src="https://community.databricks.com/t5/image/serverpage/image-id/31291i14A36CC3F04565B3/image-size/medium?v=v2&amp;amp;px=400" role="button" title="Wola_0-1789753526825.png" alt="Wola_0-1789753526825.png" /&gt;&lt;/span&gt;&lt;/P&gt;&lt;P&gt;P.S.: I might not have explained it well, but I really need help with it.&lt;/P&gt;</description>
      <pubDate>Fri, 18 Sep 2026 17:49:31 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/data-ingestion-setting-up-a-connector-for-postgres-with-cdc/m-p/169117#M56042</guid>
      <dc:creator>Wola</dc:creator>
      <dc:date>2026-09-18T17:49:31Z</dc:date>
    </item>
    <item>
      <title>Re: Data ingestion: Setting up a connector for Postgres with CDC enabled.</title>
      <link>https://community.databricks.com/t5/data-engineering/data-ingestion-setting-up-a-connector-for-postgres-with-cdc/m-p/169238#M56063</link>
      <description>&lt;P&gt;Hi Wola,&lt;/P&gt;&lt;P&gt;Don't worry about your Postgres side, that's most likely not the problem. The greyed-out option is coming from Databricks. The PostgreSQL CDC connector in Lakeflow Connect is still in Public Preview, and this one isn't self-service: the docs say "Contact your Databricks account team to request access." There is nothing to flip on the Previews page. Until the workspace is enrolled, the wizard only lets you pick Query-based capture, which is exactly what your screenshot shows.&lt;BR /&gt;&lt;A href="https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/postgresql" target="_blank"&gt;https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/postgresql&lt;/A&gt;&lt;/P&gt;&lt;P&gt;So step one is a message to your account team asking to enable the PostgreSQL connector preview for your workspace.&lt;/P&gt;&lt;P&gt;While you wait, two things worth checking. The CDC pipeline needs serverless compute enabled in the workspace (the gateway runs on classic compute, the pipeline itself is serverless), and it only replicates from a primary instance, read replicas won't work.&lt;BR /&gt;&lt;A href="https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/postgresql-pipeline" target="_blank"&gt;https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/postgresql-pipeline&lt;/A&gt;&lt;/P&gt;&lt;P&gt;And the RDS checklist from the docs, just to compare with what you've done: rds.logical_replication = 1 in the parameter group, a replication user with the rds_replication role and the REPLICATION attribute, a publication, a replication slot created with pgoutput (the only plugin supported), and REPLICA IDENTITY set to DEFAULT or FULL on every table. The slot name and publication name are what the wizard asks for later, in the Database setup step.&lt;BR /&gt;&lt;A href="https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/postgresql-source-setup" target="_blank"&gt;https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/postgresql-source-setup&lt;/A&gt;&lt;BR /&gt;&lt;A href="https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/postgresql-limits" target="_blank"&gt;https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/postgresql-limits&lt;/A&gt;&lt;/P&gt;&lt;P&gt;If you can't wait, Query-based capture does work with Postgres today, no preview needed. Just know what you're getting: it doesn't read the WAL, it runs on a schedule and picks up changes through a cursor column (a timestamp or increasing id) per table. You won't see intermediate states of a row, and hard deletes are only tracked in Beta. Fine for a lot of use cases, but it isn't real CDC.&lt;BR /&gt;&lt;A href="https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/query-based-overview" target="_blank"&gt;https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/query-based-overview&lt;/A&gt;&lt;/P&gt;&lt;P&gt;Good luck with it.&lt;/P&gt;</description>
      <pubDate>Sun, 20 Sep 2026 12:00:29 GMT</pubDate>
      <guid>https://community.databricks.com/t5/data-engineering/data-ingestion-setting-up-a-connector-for-postgres-with-cdc/m-p/169238#M56063</guid>
      <dc:creator>ThomazNeto</dc:creator>
      <dc:date>2026-09-20T12:00:29Z</dc:date>
    </item>
  </channel>
</rss>

