Databricks DLT Joins: Streaming table join with Delta table is reading 2 Billion records per batch

gudurusreddy99
New Contributor II

Databricks DLT Joins: Streaming table join with Delta table is reading 2 Billion records from Delta Table for each and every Micro batch.

How to overcome this issue to not to read 2 Billion records for every micro batch.

Your suggestions and feedback will be highly appreciated.

 

Thanks

Srini