Databricks Community

faruko · 04-28-2026

Hello everyone,I am responsible for designing and implementing a Lakehouse architecture in an industrial company.I am currently facing some challenges regarding the initial ingestion of data from our on‑premise Oracle database into Databricks.The dat...

faruko · 04-29-2026

Hi @amirabedhiafi,Thank you for your answer, I found it very helpful. It actually gave me an idea.What if I use a database backup for the initial load instead of performing the first backfill step? This way, I could ingest all the historical data at ...

faruko · 04-28-2026

Thank you for your suggestion.Unfortunately, we do not have a unique incremental ID. Our data is identified by multiple tag_ids, with one record per tag every minute, based on a timestamp.We initially considered using spark.readStream to load histori...

Databricks Community

User Stats

User Activity

Best practices for initial large-scale ingestion from on‑premises Oracle to Databricks

Re: Best practices for initial large-scale ingestion from on‑premises Oracle to Databricks

Re: Best practices for initial large-scale ingestion from on‑premises Oracle to Databricks