Databricks Community

faruk

Hi everyone,We ingest Oracle tables into a Bronze layer with Lakeflow Connect, and our Silver layer is a Lakeflow Spark Declarative Pipeline made of materialized views that read the Bronze tables and apply types and comments from our data dictionary....

faruk

Hi everyone,We ingest data from our source database with Lakeflow Connect, through a foreign catalog, into a Bronze layer. In the Silver layer, we apply the correct data types and constraints based on our data dictionary.Recently, some tables in the ...

faruk

Hi everyone,I build reports in Databricks from Excel files maintained by many different business users. The files are varied and come from different teams, and I haven’t settled on an approach yet.One idea I’m considering: create a landing location w...

faruk

Hello Databricks Community,We are using a Lakeflow Connect managed ingestion pipeline with the query-based connector to ingest Oracle tables via Unity Catalog foreign catalogs (Lakehouse Federation) on Azure Databricks.One of our requirements is to c...

faruk · 09-10-2026

Hello everyone,I've just started a new position and my goal is to build a Data Lakehouse with Databricks. I have no previous experience with Databricks and I'm being helped by an external company. The goal is to centralize all our data in Databricks....

faruk

@pradeep_singhThanks for the explanation, that makes sense. Let me give a bit more context on my case, because I think it's slightly different.The data has already been corrected in Oracle. The problem is that Lakeflow Connect resumes ingestion from ...

faruk

@saurabh18cs Most likely yes. What I can confirm is that last_update_date did not change for the existing rows, so the connector didn’t re-read them. I believe the column was added with the default directly in the ALTER TABLE statement, which would m...

faruk

Hi @ThomazNeto , Thank you for you detailed answer.

faruk

@data_pulse Thank you i will give a try ! I like the approach

faruk

@juanlozadab Thank you for your answer but it will be difficult to build an App for me. And our user will probably never go there

Databricks Community

User Stats

User Activity

Lakeflow Connect (Oracle): backfill a single new column without a full refresh of the table

Schema evolution: new NOT NULL column fails on existing Silver data (Lakeflow Connect source)

How do you collect Excel files from business users into Databricks ?

Lakeflow Connect – Hard Deletion Sync: GA Timeline and Production Readiness

Oracle NUMBER → DecimalType(38,10) on ingestion, and silver layer best practices

Re: Lakeflow Connect (Oracle): backfill a single new column without a full refresh of the table

Re: Lakeflow Connect (Oracle): backfill a single new column without a full refresh of the table

Re: Schema evolution: new NOT NULL column fails on existing Silver data (Lakeflow Connect source)

Re: How do you collect Excel files from business users into Databricks ?

Re: How do you collect Excel files from business users into Databricks ?