Databricks Community

Oumeima

Hi all,We run a Lakeflow Connect SQL Server ingestion pipeline with the gateway in continuous mode, reading from an Azure SQL Database using an Entra ID service principal (OAuth2 client credentials). The setup works overall, but we see a constant low...

Oumeima · 02-27-2026

Hello,I am trying to ingest data from an Azure SQL Database using lakeflow connect.- I'm using a service principle for authentication (created the login and user in the DB am trying to ingest)- The utility script was executed by a DB owner=== Install...

Oumeima · 07-02-2025

I am building a databricks app using databricks asset bundles. I need to use a helpers packages that i built as an artifact and using in other resources outside the app. The only way to use it is to have the built package inside the app source code f...

Oumeima · 04-26-2026

We figured out the issue finally! We checked the database sql audit logs and noticed that there was a particular query that was taking too long (4min) for the ingestion user. This was causing a timeout. This query is very simple and takes usually a c...

Oumeima · 03-02-2026

Hello, Thank you for your reply! Both ingestion gateway and ingestion pipeline are running correctly. I couldn't spot any a clear error message in the logs but i could troubleshoot something. I tested using a user that has the role "db_owner" (to dis...

Oumeima · 12-03-2025

Hello,The solution i found is as follows:In my CI/CD pipeline that takes care of deploying the databricks app (am using databricks asset bundles to manage my resources), i added a job running a shell script that appends the volume path to the require...

Oumeima · 10-30-2025

Hello, thank you for the reply. That's precisely what i did actually. I built a CI/CD pipeline to deploy the package to a volume and then referenced it in my requirements.txt file.

Databricks Community

User Stats

User Activity

Lakeflow Connect SQL Server gateway – intermittent Entra ID token auth failures (18456, state 132)

Lakeflow Connect - SQL Server - Database Setup step keeps failing

I can't use my own .whl package in Databricks app with databricks asset bundles

Re: Lakeflow Connect - SQL Server - Database Setup step keeps failing

Re: Lakeflow Connect - SQL Server - Database Setup step keeps failing

Re: I can't use my own .whl package in Databricks app with databricks asset bundles

Re: I can't use my own .whl package in Databricks app with databricks asset bundles