sajith_appukutt
Databricks Employee
Databricks Employee

‎06-22-2021 11:33 PM

What would be the volume of data in Redis ?

Option 1: Read redis data into a dataframe and do a stream/static join

Option 2: Inside foreachBatch

  • Get redis connection
    • fetch lookup data by keys
    • perform the enrichment
    • close connection

0 Kudos