09-22-2024 10:48 PM
How to decide whether to go for Streaming or Batch processing when the upstream is DELTA table?
Please share suggestions to optimize the load timings.
09-23-2024 02:05 PM
What is your end goal? Read the Delta table and create Silver and Gold tables. What is your SLA from the source Delta table to the destination?
09-23-2024 02:06 PM
Structured Streaming is one of the options, spark.readStream.format("delta")
