https://community.databricks.com/t5/data-engineering/streaming-or-batch-processing/m-p/91490#M38174 <P><SPAN>Structured Streaming is one of the options,&nbsp;</SPAN><SPAN>spark</SPAN><SPAN class="token token punctuation">.</SPAN><SPAN>readStream</SPAN><SPAN class="token token punctuation">.</SPAN><SPAN class="token token">format</SPAN><SPAN class="token token punctuation">(</SPAN><SPAN class="token token">"delta"</SPAN><SPAN class="token token punctuation">)</SPAN></P> Mon, 23 Sep 2024 21:06:43 GMT gchandra 2024-09-23T21:06:43Z https://community.databricks.com/t5/data-engineering/streaming-or-batch-processing/m-p/91363#M38158 <P>How to decide whether to go for Streaming or Batch processing when the upstream is DELTA table?</P><P>Please share suggestions to optimize the load timings.</P> Mon, 23 Sep 2024 05:48:37 GMT https://community.databricks.com/t5/data-engineering/streaming-or-batch-processing/m-p/91363#M38158 sashikanth 2024-09-23T05:48:37Z https://community.databricks.com/t5/data-engineering/streaming-or-batch-processing/m-p/91489#M38173 <P>What is your end goal? Read the Delta table and create Silver and Gold tables.&nbsp;<BR />What is your SLA from the source Delta table to the destination?<BR /><BR /></P> <P>&nbsp;</P> Mon, 23 Sep 2024 21:05:35 GMT https://community.databricks.com/t5/data-engineering/streaming-or-batch-processing/m-p/91489#M38173 gchandra 2024-09-23T21:05:35Z https://community.databricks.com/t5/data-engineering/streaming-or-batch-processing/m-p/91490#M38174 <P><SPAN>Structured Streaming is one of the options,&nbsp;</SPAN><SPAN>spark</SPAN><SPAN class="token token punctuation">.</SPAN><SPAN>readStream</SPAN><SPAN class="token token punctuation">.</SPAN><SPAN class="token token">format</SPAN><SPAN class="token token punctuation">(</SPAN><SPAN class="token token">"delta"</SPAN><SPAN class="token token punctuation">)</SPAN></P> Mon, 23 Sep 2024 21:06:43 GMT https://community.databricks.com/t5/data-engineering/streaming-or-batch-processing/m-p/91490#M38174 gchandra 2024-09-23T21:06:43Z