Reduce the Time for First Spark Streaming Run Kick off
Options
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
11-25-2025 10:43 AM
Hi Team,
Currently I have a Silver Delta Table(External) is loading on Streaming and the Gold is on Batch.
I Need to Make the Gold Delta as well to Streaming. In My First Run I can the stream initializing process is taking an hour or so as my Silver table is Heavy... The Current Gold has the data processed till last batch still then why it is taking so long. Can we Improve to reduce this time. This is been now tested in QA. Before Prod need some solution to it.
Labels:
- Labels:
-
Spark