Databricks Community

Oumeima

Setup:- Lakeflow Connect, SQL Server source, `connector_type: CDC`, integrated pipeline (gateway-less — extraction and apply in one triggered pipeline on classic compute)- Deployed with Declarative Automation Bundles, `databricks-bundles` 1.20.0, CLI...

Oumeima · 08-31-2026

Environment:Databricks Runtime: Current channel, Photon enabledEdition: ProPlatform: AzureDescription:My setup consists of:A managed ingestion pipeline for a SQL Server database that ingests raw data into bronze Delta tables (SCD Type 1), consisting ...

Oumeima · 08-11-2026

Calling get_token() on a Unity Catalog service credential fails for any scope using the api:// App ID URI format. Only https://-scheme resource scopes succeed. The same api:// scopes work correctly with a service principal.Reproductioncredential = db...

Oumeima · 08-03-2026

Hi all,We run a Lakeflow Connect SQL Server ingestion pipeline with the gateway in continuous mode, reading from an Azure SQL Database using an Entra ID service principal (OAuth2 client credentials). The setup works overall, but we see a constant low...

Oumeima · 02-27-2026

Hello,I am trying to ingest data from an Azure SQL Database using lakeflow connect.- I'm using a service principle for authentication (created the login and user in the DB am trying to ingest)- The utility script was executed by a DB owner=== Install...

Oumeima · 09-02-2026

Thank you for the guidance. We followed your investigation steps and confirmed your hypothesis.Findings:We checked the ingestion pipeline event log, DESCRIBE HISTORY on the affected bronze tables, and the silver pipeline event log.The Lakeflow Connec...

Oumeima · 09-02-2026

Thanks everyone for your responses.@ShamenParis TBLPROPERTIES ("pipelines.reset.allowed" = "true") seems to be set by default.@Satyasai a second full refresh would fix the issue but we want to avoid doing that especially in production

Oumeima · 08-24-2026

hey @Zachary_Higgins,No they didn't provide me with a reference number. You just check this box and only then they might come back to you i believeLet me know if you happen to know another way to do this 

Oumeima · 08-21-2026

Hello @LaurentLeturgez,Thank you for sharing this article, I found it particularly valuable!I have a technical question: can create_auto_cdc_flow() in the SDK support auto-incremental surrogate identity keys for SCD2 implementations, similar to the S...

Oumeima · 08-19-2026

Hello, a quick update on thisI reached out to the databricks support team and they confirm that Unity Catalog service credentials do not support "api://" URIs. this is a known product limitation. They asked me to file for a feature request with Datab...

Databricks Community

User Stats

User Activity

Lakeflow Connect SQL Server (integrated CDC pipeline): no way to Include/exclude columns

Streaming tables fail with DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE_USE_SCHEMA_LOG after adding a

Unity Catalog service credential get_token rejects api:// scope format — "not a valid URI"

Lakeflow Connect SQL Server gateway – intermittent Entra ID token auth failures (18456, state 132)

Lakeflow Connect - SQL Server - Database Setup step keeps failing

Re: Streaming tables fail with DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE_USE_SCHEMA_LOG after addin

Re: Streaming tables fail with DELTA_STREAMING_INCOMPATIBLE_SCHEMA_CHANGE_USE_SCHEMA_LOG after addin

Re: Unity Catalog service credential get_token rejects api:// scope format — "not a valid URI&q

Re: Identity Columns Best Practices for Databricks Lakehouse

Re: Unity Catalog service credential get_token rejects api:// scope format — "not a valid URI&q