Hi @Brahmareddy ,

Really enjoyed your hackathon demo. you’ve set a high bar for NLP-focused projects. I picked up a lot from your approach and it’s definitely given me ideas to try out.

For my hackathon entry, I took a similar direction using pyspark.ml.clustering with an LDA topic modelling approach to drive recommendations via clustering. In my case, I categorised recipes into topics based on word frequency and distribution across a large dataset. That gives each recipe a topic “label”, which can then be used to recommend similar recipes based on their semantic profile. 

If you’re interested, you can check it out here:
https://www.youtube.com/watch?v=JX0qyBD7qyM