- 47 Views
- 2 replies
- 1 kudos
Women’s Week: The Ultimate Challenge - Day 5
We’ve taken on exciting challenges and explored different perspectives all week, now it’s time for the ultimate one! As we wrap up, let’s envision the minds that will shape the future of Data & AI. Imagine it’s the year 2125, and you are documenting...
- 47 Views
- 2 replies
- 1 kudos
- 1 kudos
Dr Mithali RamanIn 2125, the tech world celebrates Dr Mithali Raman, who revolutionized data privacy and security. In 2097, she introduced the Quantum Privacy Shield (QPS), an unbreakable encryption framework powered by quantum computing that ensures...
- 1 kudos
- 72 Views
- 4 replies
- 2 kudos
Women’s Week Challenge - Day 4
Let's make today fun and engaging! I'll start by giving a creative definition of a Databricks feature/tool, and your task is to guess what it is! ️ How to play:1️⃣ Read the last person's Definition.2️⃣ Guess the Databricks feature/tool they descr...
- 72 Views
- 4 replies
- 2 kudos
- 2 kudos
I think the answer is "Databricks Workspace"Here's a new one:Imagine a futuristic delivery system where robots zoom around a massive warehouse, picking up packages and dropping them off at exactly the right spots. No delays, no mix-ups, every item ge...
- 2 kudos
- 84 Views
- 3 replies
- 1 kudos
Women’s Week Challenge - Day 3
Day 3 is here! Let's dive into engaging challenges!! Today's Challenges: Databricks Emoji Challenge: Let's test our Databricks knowledge with emoji-based clues! Drop an emoji combo, and the next person must guess the Databricks feature or concept i...
- 84 Views
- 3 replies
- 1 kudos
- 1 kudos
1) Auto Loader, right? Now guess this: ️2) I completely agree with your answer @Nikita_Garg
- 1 kudos
- 178 Views
- 5 replies
- 1 kudos
Women’s Week Challenge - Day 2
Ready for another round of brain teasers and AI fun? Let's go! Today's Challenges: 易 If you could teach AI one human emotion, what would it be and why? 易 A machine learning model has the following metrics: Precision = 80%, Recall = 70%, Total Predic...
- 178 Views
- 5 replies
- 1 kudos
- 1 kudos
1) Teaching AI about happiness would allow it to create more positive interactions. If AI understands happiness, it could encourage people during difficult times.2) 80%3) A common Databricks mistake is inefficient partitioning in Delta Lake tables, w...
- 1 kudos
- 402 Views
- 5 replies
- 9 kudos
Women’s Week Challenge - Day 1
Join the Women in Data + AI fun! Everyone can participate, but swag is for our amazing Women members! Today's Challenges: What's the most unexpected use of AI? Find the pattern in this AI-generated sequence: 1, 11, 21, 1211, 111221,? 易 (Bonus: If y...
- 402 Views
- 5 replies
- 9 kudos
- 9 kudos
What's the most unexpected use of AI?Ancient Text Restoration – AI helps restore and read ancient, burnt, or faded manuscripts, including scrolls from Pompeii that were too fragile to open. Find the pattern in this AI-generated sequence: 1, 11, 21, ...
- 9 kudos
- 622 Views
- 3 replies
- 4 kudos
Women’s Week Challenge: Play, Engage & Win Swag
It's Women's Week, and we're turning up the energy! From March 3 - March 9, every action you take in the Community earns you points. The top 3 women contributors win exclusive Databricks Swag! Who Can Participate ?? Everyone! This challenge is open...
- 622 Views
- 3 replies
- 4 kudos
- 187 Views
- 0 replies
- 3 kudos
GDPR & CCPA Compliance with Delta Lake
Hello, Data & AI Enthusiasts! In today’s data-driven world, organizations are managing enormous volumes of data. With this vast amount of data comes the responsibility to protect personal information, which is becoming increasingly important due to ...
- 187 Views
- 0 replies
- 3 kudos
- 204 Views
- 0 replies
- 1 kudos
Celebrating Women in Data & AI This December!
As we embrace the season of joy and reflection, let’s take a moment to celebrate the amazing women in Data and AI who are shaping the future! What’s been your most memorable achievement in Data & AI this year?Who’s been your biggest source of inspir...
- 204 Views
- 0 replies
- 1 kudos
- 1568 Views
- 1 replies
- 2 kudos
𝐭𝐫𝐚𝐧𝐬𝐟𝐨𝐫𝐦𝐚𝐭𝐢𝐨𝐧𝐬 𝐚𝐧𝐝 𝐚𝐜𝐭𝐢𝐨𝐧𝐬 𝐮𝐬𝐞𝐝 𝐢𝐧 𝐀𝐩𝐚𝐜𝐡𝐞 𝐒𝐩𝐚𝐫𝐤
퐋퐢퐬퐭 퐨퐟 퐭퐫퐚퐧퐬퐟퐨퐫퐦퐚퐭퐢퐨퐧퐬 퐚퐧퐝 퐚퐜퐭퐢퐨퐧퐬 퐮퐬퐞퐝 퐢퐧 퐀퐩퐚퐜퐡퐞 퐒퐩퐚퐫퐤 퐃퐚퐭퐚퐅퐫퐚퐦퐞퐬 퐟퐨퐫 퐚 퐃퐚퐭퐚 퐄퐧퐠퐢퐧퐞퐞퐫퐢퐧퐠 퐫퐨퐥퐞:퐓퐫퐚퐧퐬퐟퐨퐫퐦퐚퐭퐢퐨퐧퐬:Transformations are operations on DataFrames that return a new DataFrame. They are lazily evaluated, meaning they do not execute immediate...
- 1568 Views
- 1 replies
- 2 kudos
- 2 kudos
Very informative thanks
- 2 kudos
- 1213 Views
- 3 replies
- 4 kudos
Resolved! spark code optimization
퐂퐨퐝퐞 퐎퐩퐭퐢퐦퐢퐳퐚퐭퐢퐨퐧 퐢퐧 퐏퐲퐒퐩퐚퐫퐤Please refer attach documentWhile exploring, I discovered an excellent document by Deepa Vasanthkumar that effectively explains spark code optimization techniques.Like and reshare
- 1213 Views
- 3 replies
- 4 kudos
- 4 kudos
First Reply Thank you @Yogic24 for sharing my blog post, This may not be complete guide, as it was meant to be only to include crisp info for a tiny blog. However any optimization would be based on the problem which we are trying to solve, and may b...
- 4 kudos
- 160 Views
- 0 replies
- 1 kudos
Empowering Women in AI: Let’s Connect & Inspire Each Other
Hello, amazing women of the Databricks AI community! As we continue to break barriers and make strides in the AI space, it's essential we come together to share our experiences, insights, and challenges. Whether you’re a seasoned expert or just star...
- 160 Views
- 0 replies
- 1 kudos
- 567 Views
- 3 replies
- 12 kudos
A Big Thank You to our Woman in Data & AI - Yogitha! 🌟
We want to take a moment to recognize and thank Yogitha for her incredible efforts in keeping the conversation alive in our Women in Data & AI community. From insightful posts to engaging discussions, Yogitha has been a driving force, inspiring u...
- 567 Views
- 3 replies
- 12 kudos
- 538 Views
- 0 replies
- 3 kudos
🙋♀️
Hello community!I'm back after a long break and excited to start sharing my knowledge on this forum again. Feel free to share your thoughts and join the conversation!Let me know if you'd like any further adjustments!
- 538 Views
- 0 replies
- 3 kudos
- 1092 Views
- 0 replies
- 0 kudos
Explain the difference between groupByKey and reduceByKey?
groupByKey and reduceByKey are transformations that can be used to process and manipulate key-value pair RDDs.groupByKey: This transformation groups all the values associated with each unique key into a single list. It returns an RDD of (key, Iterabl...
- 1092 Views
- 0 replies
- 0 kudos
- 802 Views
- 2 replies
- 5 kudos
Spark concept A TO Z
hello everyone,Spark Concepts A to Z!!A - Adaptive Query Execution (AQE):Optimizes query plans dynamically based on runtime statistics for improved performance and resource utilization.B - Broadcast Join:Sends small datasets to all nodes for local jo...
- 802 Views
- 2 replies
- 5 kudos
