Databricks Community

FAHADURREHMAN · 04-09-2026

Hi Legends, I have a timeseries DELTA table having 707.1GiB, 7702 files, 262 Billion rows. (Mainly its timeseries data). This table is clustered on 2 columns (Timestamp col & 2nd one is descriptive column)I have designed a pipeline which runs every w...

FAHADURREHMAN · 02-26-2026

Hi All, I have a DLT Pipeline setup which reading Parquets from S3 Bucket and create a materialized view. Created view is quite big and contains Billion of records and contain around few TB of data. Predictive Optimization is already enabled. automat...

FAHADURREHMAN · 02-23-2026

Hi All, I am trying to read csv files from one Folder of S3 bucket. For this particular used case, I do not intent to read from sub folders. I am using below code however its reading all CSVs in sub folders as well. How can i avoid that? I used many ...

FAHADURREHMAN · 04-09-2026

Thsnk @anuj_lathi , Should I enable Partitioning and Z-Ordering and move away from Clustering for the target table?

FAHADURREHMAN · 02-25-2026

Thanks @Saritha_S for your prompt feedback and support. Suggested option worked for me.

Databricks Community

User Stats

User Activity

DELTA Merge taking too much Time

Optimizing Large Materialized View to expedite query execution

DLT Auto Loader Reading from Parent S3 Folder not Sub Folders

Re: DELTA Merge taking too much Time

Re: DLT Auto Loader Reading from Parent S3 Folder not Sub Folders