In the fast-moving world of Data & AI, the magic often lies in combining the tools we use. When the right technologies come together, they don’t just add value, they multiply it. Here are some combinations that show what’s possible when the right too...
We’ve taken on exciting challenges and explored different perspectives all week, now it’s time for the ultimate one! As we wrap up, let’s envision the minds that will shape the future of Data & AI. Imagine it’s the year 2125, and you are documenting...
Dr Mithali RamanIn 2125, the tech world celebrates Dr Mithali Raman, who revolutionized data privacy and security. In 2097, she introduced the Quantum Privacy Shield (QPS), an unbreakable encryption framework powered by quantum computing that ensures...
Let's make today fun and engaging! I'll start by giving a creative definition of a Databricks feature/tool, and your task is to guess what it is! ️ How to play:1️⃣ Read the last person's Definition.2️⃣ Guess the Databricks feature/tool they descr...
I think the answer is "Databricks Workspace"Here's a new one:Imagine a futuristic delivery system where robots zoom around a massive warehouse, picking up packages and dropping them off at exactly the right spots. No delays, no mix-ups, every item ge...
Day 3 is here! Let's dive into engaging challenges!! Today's Challenges: Databricks Emoji Challenge: Let's test our Databricks knowledge with emoji-based clues! Drop an emoji combo, and the next person must guess the Databricks feature or concept i...
1) Auto Loader, right? Now guess this: ️2) I completely agree with your answer @Nikita_Garg
Ready for another round of brain teasers and AI fun? Let's go! Today's Challenges: 易 If you could teach AI one human emotion, what would it be and why? 易 A machine learning model has the following metrics: Precision = 80%, Recall = 70%, Total Predic...
1) Teaching AI about happiness would allow it to create more positive interactions. If AI understands happiness, it could encourage people during difficult times.2) 80%3) A common Databricks mistake is inefficient partitioning in Delta Lake tables, w...
Join the Women in Data + AI fun! Everyone can participate, but swag is for our amazing Women members! Today's Challenges: What's the most unexpected use of AI? Find the pattern in this AI-generated sequence: 1, 11, 21, 1211, 111221,? 易 (Bonus: If y...
What's the most unexpected use of AI?Ancient Text Restoration – AI helps restore and read ancient, burnt, or faded manuscripts, including scrolls from Pompeii that were too fragile to open. Find the pattern in this AI-generated sequence: 1, 11, 21, ...
It's Women's Week, and we're turning up the energy! From March 3 - March 9, every action you take in the Community earns you points. The top 3 women contributors win exclusive Databricks Swag! Who Can Participate ?? Everyone! This challenge is open...
Hello, Data & AI Enthusiasts! In today’s data-driven world, organizations are managing enormous volumes of data. With this vast amount of data comes the responsibility to protect personal information, which is becoming increasingly important due to ...
As we embrace the season of joy and reflection, let’s take a moment to celebrate the amazing women in Data and AI who are shaping the future! What’s been your most memorable achievement in Data & AI this year?Who’s been your biggest source of inspir...
퐋퐢퐬퐭 퐨퐟 퐭퐫퐚퐧퐬퐟퐨퐫퐦퐚퐭퐢퐨퐧퐬 퐚퐧퐝 퐚퐜퐭퐢퐨퐧퐬 퐮퐬퐞퐝 퐢퐧 퐀퐩퐚퐜퐡퐞 퐒퐩퐚퐫퐤 퐃퐚퐭퐚퐅퐫퐚퐦퐞퐬 퐟퐨퐫 퐚 퐃퐚퐭퐚 퐄퐧퐠퐢퐧퐞퐞퐫퐢퐧퐠 퐫퐨퐥퐞:퐓퐫퐚퐧퐬퐟퐨퐫퐦퐚퐭퐢퐨퐧퐬:Transformations are operations on DataFrames that return a new DataFrame. They are lazily evaluated, meaning they do not execute immediate...
Very informative thanks
퐂퐨퐝퐞 퐎퐩퐭퐢퐦퐢퐳퐚퐭퐢퐨퐧 퐢퐧 퐏퐲퐒퐩퐚퐫퐤Please refer attach documentWhile exploring, I discovered an excellent document by Deepa Vasanthkumar that effectively explains spark code optimization techniques.Like and reshare
First Reply Thank you @Yogic24 for sharing my blog post, This may not be complete guide, as it was meant to be only to include crisp info for a tiny blog. However any optimization would be based on the problem which we are trying to solve, and may b...
Hello, amazing women of the Databricks AI community! As we continue to break barriers and make strides in the AI space, it's essential we come together to share our experiences, insights, and challenges. Whether you’re a seasoned expert or just star...
We want to take a moment to recognize and thank Yogitha for her incredible efforts in keeping the conversation alive in our Women in Data & AI community. From insightful posts to engaging discussions, Yogitha has been a driving force, inspiring u...
Hello community!I'm back after a long break and excited to start sharing my knowledge on this forum again. Feel free to share your thoughts and join the conversation!Let me know if you'd like any further adjustments!
groupByKey and reduceByKey are transformations that can be used to process and manipulate key-value pair RDDs.groupByKey: This transformation groups all the values associated with each unique key into a single list. It returns an RDD of (key, Iterabl...
