cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Yogic24
Valued Contributor II
since ‎06-12-2024
3 weeks ago

User Stats

  • 31 Posts
  • 2 Solutions
  • 57 Kudos given
  • 39 Kudos received

User Activity

🙋‍♀️

10-21-2024
‍♀️ Hello community!I'm back after a long break and excited to start sharing my knowledge on this forum again. Feel free to share your thoughts and join the conversation!Let me know if you'd like any further adjustments!

Explain the difference between groupByKey and reduceByKey?

10-21-2024
groupByKey and reduceByKey are transformations that can be used to process and manipulate key-value pair RDDs.groupByKey: This transformation groups all the values associated with each unique key into a single list. It returns an RDD of (key, Iterabl...

𝐭𝐫𝐚𝐧𝐬𝐟𝐨𝐫𝐦𝐚𝐭𝐢𝐨𝐧𝐬 𝐚𝐧𝐝 𝐚𝐜𝐭𝐢𝐨𝐧𝐬 𝐮𝐬𝐞𝐝 𝐢𝐧 𝐀𝐩𝐚𝐜𝐡𝐞 𝐒𝐩𝐚𝐫𝐤

08-01-2024
퐋퐢퐬퐭 퐨퐟 퐭퐫퐚퐧퐬퐟퐨퐫퐦퐚퐭퐢퐨퐧퐬 퐚퐧퐝 퐚퐜퐭퐢퐨퐧퐬 퐮퐬퐞퐝 퐢퐧 퐀퐩퐚퐜퐡퐞 퐒퐩퐚퐫퐤 퐃퐚퐭퐚퐅퐫퐚퐦퐞퐬 퐟퐨퐫 퐚 퐃퐚퐭퐚 퐄퐧퐠퐢퐧퐞퐞퐫퐢퐧퐠 퐫퐨퐥퐞:퐓퐫퐚퐧퐬퐟퐨퐫퐦퐚퐭퐢퐨퐧퐬:Transformations are operations on DataFrames that return a new DataFrame. They are lazily evaluated, meaning they do not execute immediate...

spark code optimization

07-22-2024
퐂퐨퐝퐞 퐎퐩퐭퐢퐦퐢퐳퐚퐭퐢퐨퐧 퐢퐧 퐏퐲퐒퐩퐚퐫퐤Please refer attach documentWhile exploring, I discovered an excellent document by Deepa Vasanthkumar that effectively explains spark code optimization techniques.Like and reshare ✅

Reading modes in spark

07-10-2024
Hello Everyone, 3 type of reading mode into pyspark:1.Permissive Mode : its a default mode. if spark is not able to parse it due to dattype mismatch then make it as null without impacting other result, i.e only issue record are null others are fine....
View more