cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Ingestion Gateway DDL Objects Missing - Lakeflow Connect

shan-databricks
Databricks Partner

5 hours ago

Facing below issue and need a solution to proceed further

Category: Error
Message: DDL objects missing on table 'DB.dbo.client'. Execute the DDL objects script and full refresh the table on the Ingestion Pipeline. Error message: '

Reason:
- Catalog is not properly configured to capture DDL changes for the provided set of tables.

How to fix:
- To capture DDL changes for a table with LakeFlow Connect, appropriate set of support objects must be setup on the catalog. Different support objects are needed depending if tables that are replicated are using CT and/or CDC extraction mechanism.
- Investigation shows that only CDC tables are included in the replication, but corresponding DDL support object do not exist in the catalog.
- Please check the documentation for information on how to properly set up the catalog for DDL capture. Link to the related documentation is provided below under 'Useful links' section.
- To create the missing support objects, please execute the T-SQL script on this catalog in 'CDC' mode. This will create CDC related support objects. Alternatively, script can be executed in 'BOTH' mode, which will create both CT and CDC support objects.

Useful links:
- Setting up Change Tracking (CT) on SQL Server: https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/sql-server/change-tracking#set-up-ddl-...
- Setting up Change Data Capture (CDC) on SQL Server: https://docs.databricks.com/aws/en/ingestion/lakeflow-connect/sql-server/cdc#set-up-ddl-capture-and-...'.
Error class: INGESTION_GATEWAY_DDL_OBJECTS_MISSING
SQL state: 42000

 

 

 

1 REPLY 1

szymon_dybczak
Esteemed Contributor III

an hour ago

Hi @shan-databricks ,

The INGESTION_GATEWAY_DDL_OBJECTS_MISSING error means that while CDC is enabled on DB.dbo.client, the LakeFlow-specific DDL support objects (triggers, stored procedures) that allow Databricks to track schema changes (DDL events like ALTER TABLE) are missing. Enabling native SQL Server CDC/CT is not enough — Databricks needs its own overlay objects on top.

 

You need to:

 

1. Download & install the utility script

 

2. Follow the steps of below tutorial:

 

https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sql-server-utility

 

If my answer was helpful, please consider marking it as accepted solution

Announcements