Lakeflow connect

ram_11 — Sat, 03 Oct 2026 06:51:17 GMT

What is extractor_sql-server-conn_cdc_sink in the Ingestion gateway pipeline in lakeflow connect and is it crreated by deafualta and how does it work?

Re: Lakeflow connect

K_Anudeep — Sat, 03 Oct 2026 07:07:56 GMT

Hi @ram_11 !

The extractor_sql-server-conn_cdc_sink is the shared CDC sink that the SQL Server CDC extractor job inside the IG pipeline writes to.

Example screenshot below:

What actually happens:

The IG extractor (the job/process) reads change rows from each table’s capture instance / CT table.
When the IG pipelines run, we see that the per-table CDC flows are defined
All of those flows append JSON into one shared sink: extractor_<connection-name>_cdc_sink.
This sink is a UC volume cdc/ directory inside your staging location where your ingesting pipeline reads from later.

Also, when you start your IG pipleine for the first time, you should see extractor_sql-server-conn_snaphsot_sink as well, which is a sink defined, one for each table where the snapshot extractor writes the initial/full-load Parquet files.

I hope this answers your question.

Re: Lakeflow connect

ram_11 — Mon, 05 Oct 2026 03:17:01 GMT

Thanks for the answer..it's now clear..I also followed the doc and understood!

topic Re: Lakeflow connect in Data Engineering

Lakeflow connect

Re: Lakeflow connect

Re: Lakeflow connect