Databricks Community Champions articles

Databricks Community Champion - April 2026 - Ashwin Varadharajan

Rishabh_Tiwari — Fri, 17 Apr 2026 16:04:23 GMT

Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud of the incredible contributions from our Bricksters, whose impact and dedication continue to elevate the experience for everyone.

This month, we’re excited to spotlight Ashwin Varadharajan @Ashwin_DSA as our Community Champion for April 2026 —

Here’s more about Ashwin in his own words —

Tell us your story: How did your journey with Databricks and the Community begin?

I've worked with data since the start of my career. It wasn't a path I consciously chose, but it's one I've genuinely enjoyed along the way. My first real exposure to cloud tooling came in 2017 when a customer I was working with decided to move off on-premises and explore cloud data warehouses. That shift opened the door to evaluating a range of platforms in the market, and Databricks was one of them.

I'll be honest, Databricks wasn't my passion back then. In the consulting world, you work with whatever the market demands. But over the years, the majority of my projects ended up being Databricks-based, and the more I worked with the platform, the more I enjoyed it.

I joined Databricks in December 2025, and it has been a fantastic ride so far. I feel genuinely lucky to be part of this growth story. One thing that stood out immediately was the onboarding experience. Rather than being thrown straight into customer projects, you're given time and space to upskill and truly understand the product. That investment pays off when you eventually sit across from a customer.

I came across the community forum during onboarding and thought I'd give it a go. A few months later, here I am, being recognised as a Community Champion. That says something about how hooked I've become!

What sparks your passion? What drives you to keep helping others, sharing knowledge, or solving tough questions here?

It's a mix of things, and there's a selfish angle to it!

Only fellow Databricks folks will fully appreciate this. The company moves fast. Really fast. Even with a strong onboarding, it's genuinely hard to keep up with every capability the platform offers, let alone become an expert in all of them. So when I discovered the community forum, I saw it as a fantastic opportunity. Real users posting real problems, and a chance for me to dig in, understand the issue, bring in my prior experience, research our internal knowledge base, test solutions in my own workspace, and share back what actually worked.

The beauty is that it's a two-way street. Yes, the user gets their question answered, but I walk away having learned something concrete. These are the exact kinds of problems I know I'll encounter when working with customers, and now I can speak to them with genuine confidence rather than theory.

As a Delivery Solutions Architect, my role sits at the intersection of programme delivery and technical guidance. Supporting the community has noticeably sharpened my technical depth, which directly feeds into the value I can bring to customers. And if I'm being reflective about it, I think it has also helped build my public presence and thought leadership in a way that felt very natural, almost as a byproduct of just trying to be useful.

Signature move: Is there a particular topic, technology, or style of contribution that people know you for?

I naturally gravitate toward topics I've lived through in my own work. DBSQL, migrations, and performance tuning sit right in that sweet spot for me. They're areas where I've spent real time, made real mistakes, and built up genuine intuition.

That said, I make a conscious effort to stretch beyond my comfort zone, especially when I notice a topic becoming relevant in my customer engagements. Unity Catalog is a good example. I'd worked with it in bits and pieces across various customers, but never truly appreciated its breadth. In my current engagement with a banking client, it has become central to the conversation, so I've been leaning into it more deliberately on the forum too. Learning by teaching, essentially.

In terms of style, I write detailed, thorough responses. I'll admit, sometimes I wonder if I'm giving too much information, but I'd rather over-explain and save the back-and-forth than leave someone half-answered. When I share code snippets, I make a real effort to run them in my own workspace first. I won't post something I haven't personally tested and convinced myself of. If I'm going to put my name next to an answer, I want to stand behind it.

A moment that mattered: Can you share one community interaction or success story that truly stayed with you?

There have been many, but two stand out.

The first isn't a single interaction but a pattern. There have been a couple of questions where, in trying to answer them properly, I did a lot of learning and writing queries to really understand the underlying feature, and eventually turned those investigations into blog posts. What started as one user's problem could help many others navigate the same real-world challenge. That ripple effect is deeply satisfying.

The second one genuinely surprised me. A number of users reported being kicked out of their Databricks portal every couple of minutes, which was understandably causing a lot of frustration. I was simply passing along feedback on an internal thread, but it turned out to be a regression issue that required a hotfix. I ended up working closely with the product team to resolve it. What stayed with me wasn't just the fix itself, but the window it gave me into how our product teams operate, how quickly they move when something real is at stake, and the fact that a community signal could directly influence a product outcome. That was a small moment of clarity about why this forum matters beyond just Q&A.

Behind the scenes: How do you find time to contribute alongside your professional work?

I try to carve out time every single day to work on a few community posts. Oddly enough, it's quite relaxing, a welcome distraction from the pace of the day job. It's a different kind of mental energy, and switching contexts into someone else's problem often helps me reset.

I gravitate toward questions that no one has yet answered. Those are the ones where a thoughtful response can make the most difference, and honestly, they also are the most interesting ones to dig into.

Learning in action: What’s something surprising or valuable you’ve learned from the community?

Two things have genuinely surprised me.

The first is the sheer volume of questions coming from Free Edition users. It really brings home how much genuine curiosity and enthusiasm there is for the platform. A lot of these users aren't asking as part of their day job. They're running pet projects, experimenting, and learning on their own time. That's been a lovely reminder that no question is a silly question. Every query is someone trying to figure something out, and they deserve a real answer.

The second is something I didn't fully anticipate when I started contributing. The moment you respond with a Databricks employee badge next to your name, the weight of that response changes. It's no longer just my personal view. It reflects on the company. That has made me think twice before I hit post. I research more carefully, I test more rigorously, and I'm more measured in how I frame things. It's a responsibility I've genuinely come to respect, and it's made me a better contributor.

Tech inspiration: What area of data and AI currently excites you most, and why?

Vibe coding, without a doubt.

I'm not a front-end developer, but I've always had ideas about what I want to build. For years, that was a real barrier. With the tooling available today, that barrier has essentially disappeared. I fully appreciate that vibe coding isn't a substitute for proper build, test, and deployment pipelines for production-grade applications. But the ability to spin up a working demo and bring an idea to life in a fraction of the time? That's genuinely transformative.

It also changes how I communicate with stakeholders. Instead of clicking through slides and hoping people stay engaged, I can actually show them something interactive that tells the story. The productivity gains are real and tangible. The hours I used to spend just researching the basics, I can now compress into a sensible prompt. And there's something liberating about asking "dumb" questions without feeling judged. That alone has made me faster and more willing to explore new areas.

On the Databricks side, this is why I'm particularly excited about offerings like Genie. It brings that same spirit of natural-language-driven exploration into the data layer, and I think we're only scratching the surface of what's possible.

Human side of data: How do you think communities like ours make technical spaces more human and connected?

Most users don't come to the community as their first stop. They've usually explored the documentation, asked an LLM, tried a few things on their own, and only when those paths don't resolve their problem do they turn to the forum. And that tells you something important.

LLMs, for all their power, don't always give the right answer. Sometimes the documentation they reference is obsolete, leading to conflicting guidance that actually makes things harder rather than easier. By the time a user posts in the community, they're often looking for something a machine can't easily provide — real experience, judgement, and the nuance of someone who has actually hit the same wall and worked through it.

What I've come to appreciate is how much community members value that human element. They're not just looking for a snippet of code. They're looking for context, reassurance, and someone who's been there. And the reverse is equally true. Most people in this community take the time to recognise the effort.

Even something as small as clicking "Accept as Solution" is a meaningful gesture. It's easy to grab an answer and disappear, but this community generally doesn't work that way, and that's what makes it feel genuinely connected.

Off the keyboard: What do you love doing outside of data and tech?

I'm an introvert at heart, and I genuinely enjoy quiet time to myself. Long walks are my favourite. They have a way of shifting my mood and energising me that few other things do.

I also love exploring food — trying new places, new cuisines, new dishes. It's one of my favourite ways to slow down and enjoy the moment.

And yes, I'll confess to the occasional series binge, usually followed by a mild crisis about how much time I've just lost. But that cycle is a universal truth, so I've made peace with it.

Words to future changemakers: What’s one piece of advice you’d give to someone hoping to make an impact in the Databricks Community?

Just start.

Post your query, write that blog, or respond to someone else's question by sharing your own experience. Quantity really doesn't matter. Even one post a week is a brilliant start. Over time, you'll notice two things happen almost in parallel. You'll learn a lot, often more than you expected. And you'll gradually build a reputation that genuinely adds value to your professional profile, sometimes in ways you don't anticipate.

The one thing I'd add is this — be kind. I occasionally see users demanding answers or venting frustration without realising that community members are contributing their own time, goodwill, and experience to help. There's a limit to what any of us can do, and a little patience and warmth go a long way. The community works because people show up for each other, so show up the same way you'd want someone to show up for you.

If you'd like to connect, you can find me on LinkedIn here:
https://www.linkedin.com/in/ashwinvaradharajan/

The Community Team would like to thank you, Ashwin, for your continued contributions and for showing what it truly means to support and grow alongside the community.

Databricks Community Champion - March 2026 - Pradeep Singh

Rishabh_Tiwari — Tue, 10 Mar 2026 11:37:27 GMT

Our Community Champion Program celebrates members who go the extra mile to share knowledge, support fellow practitioners, and help the Databricks Community grow stronger every day. These champions bring curiosity, experience, and a genuine willingness to help others succeed with data and AI.

This month, we’re excited to spotlight Pradeep Singh, whose journey through multiple data roles and passion for the Databricks ecosystem reflect the spirit of continuous learning and giving back that our community thrives on.

Here’s more about @pradeep_singh in his own words —

Can you provide a brief overview of your career journey leading up to your current role?

I started my career as a Mainframe developer at CGI 15 years ago. Staring at the black screen all day was no fun, so I kept learning new technologies. This was the same time when Hadoop was gaining popularity. I spent hours learning the technology and associated tools and frameworks. I spent a few years working with Hadoop, SAS, and AWS Cloud (AWS Glue) after that. I loved Spark, but working with AWS Glue was painful. When I got to try Databricks, I instantly fell in love.

I have been a Full Stack Developer, SRE Lead, Platform Admin, Data Engineer, and Data Architect, but decided to focus specifically on Databricks, as that is where the future of Data and AI leads. At Slalom, I got to explore and learn a lot, and when the opportunity to work specifically on Databricks came along at Computomic, I was thrilled. I am doing my dream job at the moment, working on the tech I absolutely love.

What do you enjoy most about your current job or role?

What I enjoy most is the intersection of high-scale data engineering and the rapid innovation of the Databricks ecosystem. Having spent years navigating everything from Mainframes to AWS Glue, I truly appreciate the elegance of a platform that just works. At Computomic, I love that I get to spend my time solving complex architectural challenges rather than fighting with the infrastructure itself. It’s incredibly rewarding to build solutions where the technology actually keeps pace with my ideas

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?

Persistent, Passionate, and Grounded

I have heard folks calling me calm and cool headed ( Even though I think I am not . I just scream inside quitly ) . I have also been called a very hard worker and passionate person.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?

When I worked with Slalom I got to meet some great folks who have influenced me to think differently . One of my colleagues and mentor Arjun Jeyapaalan ( who now works for Databricks ) has helped me the most . Not just with work but life in general.

When and why did you first start using Databricks?

I first started using Databricks about seven years ago. At the time, I was managing big data workloads using Hadoop and AWS Glue, but I found the overhead of infrastructure management and the 'pain points' of Glue's developer experience to be significant bottlenecks.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
Databricks Asset Bundle .Assistant , Playground , Notebooks . Workflows , Spark Declarative Pipelines ( to name a few . these are what i use on a daily basis and love the most)

Is there a Databricks feature you wish existed or would like to see in future updates?

I wish for most cost control features on Serveless .

I wish we had a way to set timeout for SDP pipelines ( formerly DLT) so it doesn't run forever or need a workflow to set it up ) .

I wish materialized views were as easy to incrementalize as I thought initially and perform ( specially when the logic gets complex ) .

When did you join the Databricks Community, and what motivated you to do so?

I joined at the beginning of this year. I have been mostly a consumer of knowledge from others for a long time, but I think I have reached a point in my career where I felt a strong motivation to give back.

What aspects of the Databricks Community do you find most valuable or enjoyable?

I really wish I had joined earlier. I learn every day from the different problems folks post, as it makes me think about those challenges and the solutions around them. I can’t personally see every possible scenario, so when someone else posts a problem, I get to dig into the solution and learn a thing or two in the process. I also love the support and help the community members have for each other.

Outside of work, what is your favourite hobby or pastime?

I love to hike and run .

Where do you envision yourself professionally in the next three years?

It's hard to see that far. I live one day at a time. But most likely I will still be working with Databricks and aim to be a much more active and impactful contributor to the community.

Want to connect with Pradeep? You can find him on LinkedIn.

Thank you @pradeep_singh for sharing your journey with us and for being part of the Databricks Community. We’re excited to see your continued contributions and the impact you’ll make as you keep learning, sharing, and helping others along the way.

Databricks Community Champion - February 2026 - Mitchell Grewer

Om_Jha — Fri, 06 Feb 2026 16:13:04 GMT

Our Champion program has always recognized customers who go above and beyond to engage, support others, and uplift the Community. At the same time, we’re fortunate to have incredible contributors within our Bricksters team whose efforts shine just as brightly. Their expertise, generosity, and community spirit truly set them apart.

Let’s celebrate their impact and meet our Brickster Champion for February 2026: Mitchell Grewer!

Here’s more about about Mitchell in his own words -

Tech inspiration: What area of data and AI currently excites you most, and why?
Automation. I don’t ever want to do the same thing twice. The ability to build, for example, batch inference into a pipeline or workflow is extremely promising. Making tasks like classification, summarization, or sentiment analysis so much more accessible. I remember how hard I worked to practice regex and fuzzy matching, and I rarely use that anymore.

Human side of data: How do you think communities like ours make technical spaces more human and connected?
Having our foundational technology open sourced, combined with Databricks free edition, make Databricks accessible to almost everyone. The limitation is now our creativity and not the technology/cost.

Off the keyboard: What do you love doing outside of data and tech?
I have four wonderful children, ages 7, 5, 4, and 2, and a puppy. I love taking my dog on walks, and my kids to the park.

Words to future changemakers: What’s one piece of advice you’d give to someone hoping to make an impact in the Databricks Community?
Focus on quality and not quantity. With the surge of AI generated content everywhere, take a moment to reflect on the person on the other side. Empathy is the best way to make an impact.

Tell us your story: How did your journey with Databricks and the Community begin?
I’ve been a big believer in community before joining the tech industry. I pioneered a shift from centralized IT reporting to Self-Service Analytics for a community of 30,000 when working for a large food company in Minnesota. I love the spark of excitement people get when they see how technology can change their life/work. That’s why I love my job as a Solution Architect. Every day, I get to sit with our customers as they fall in love with the Databricks platform the way I did.

What sparks your passion? What drives you to keep helping others, sharing knowledge, or solving tough questions here?
It’s pretty simple. It feels good. It’s validating. It makes my contributions about something bigger than myself. Also, I think there’s no better way to convert memorization into learning than trying to teach or explain it to someone else. It helps you catch the parts that just aren’t that clear.

Signature move: Is there a particular topic, technology, or style of contribution that people know you for?
Honestly? Memes. GIFs. I like turning human interactions into comic strips.

A moment that mattered: Can you share one community interaction or success story that truly stayed with you?
I still see people I collaborated with years ago, who got their start in the Analytics community, progressing into successful careers in data. The most successful are often the ones with deep subject matter expertise that learned to harness data.

Behind the scenes: How do you find time to contribute alongside your professional work? Are there any rituals, habits, or motivational hacks?
Follow my neurodivergence wherever it takes me? I am not capable of rituals, habits, or motivational hacks. I am capable of relentless focus in whatever stirs my brain in the moment.

Learning in action: What’s something surprising or valuable you’ve learned from the community?
The most valuable part of the community is the diversity. I only get to see a fraction of use cases, struggles, and victories from my day job, getting to see and interact with others outside of my core responsibilities is a great perspective.

The Community Team would like to thank you for your continued support, Mitchell.

As you explore his story, we invite you to connect with him @Commitchelland gain insights from his commitment to continuous growth and community leadership. His journey is an inspiring example for anyone striving to make a difference.

Databricks Community Champion - January 2026 - Raman Gupta

Om_Jha — Tue, 13 Jan 2026 11:05:56 GMT

We are excited to spotlight Raman Gupta, one of our most insightful and expert contributors in the Databricks Community, whose journey reflects the spirit of learning, collaboration, and innovation we value most.

Here’s more about about Raman in his own words -

Featured Member Introduction

Name: Raman Gupta
Community Nickname: @Raman_Unifeye
Pronouns: He/Him
Company: Unifeye
Job Title: Head of Architecture

Can you share a bit about your career journey?

I began my IT career in 2005 as a Software Developer at Infosys, where I first specialized as an ETL Engineer. Early on, I discovered my passion for data—cleansing, enriching, and transforming raw information into actionable business insights.

Over the years, I’ve evolved alongside the industry, transitioning from traditional Data Warehousing into Big Data and Cloud ecosystems. My experience spans global financial institutions like JPMC and Barclays, where I served in roles from Data Engineer to Lead Architect. I’ve led major modernization programs, moving on-premise systems to cloud platforms such as AWS, Azure, and GCP, and building enterprise-grade solutions spanning both batch and real-time streaming.

Most recently, I joined Unifeye, a UK-based Databricks Pureplay partner, as Head of Architecture. Last year, I earned my Databricks Champion credential, reflecting my deep technical expertise and commitment to advancing the Databricks ecosystem.

What do you enjoy most about your current role?

As a Databricks Champion, I have the privilege of working closely with Databricks Account and Solution Executives to design cutting-edge data solutions. What I enjoy most is the freedom to innovate—Databricks provides such a seamless environment for experimentation that I can turn ideas into tangible, high-performance results very quickly. I’m a hands-on architect who thrives on building real, impactful solutions rather than just prototypes.

How would you describe yourself in three words? How might your colleagues describe you?

That’s always a tricky question! I’d describe myself as an analytical thinker, a lifelong learner, and a dedicated mentor.
My colleagues would probably say I’m a trustworthy go-to person who stays calm under pressure and brings clarity to complex architectural challenges.

Have any mentors influenced your professional journey?

I’ve been fortunate to have several mentors throughout my career.
In recent years, Bianca Stratulat has been a key influence, guiding me along my Databricks Champion journey—and I’m lucky to continue working with her in my current role. I also owe gratitude to Phong Diep, a brilliant technical manager who helped me develop stronger soft skills, especially around composure and professionalism during high-pressure situations.

When did you first start using Databricks?

My Databricks journey began in 2018 while leading a Proof of Concept (POC) to migrate legacy Cloudera workloads to the cloud. The performance improvements and simplicity of the platform were so impressive that I’ve been a strong advocate ever since.

Today, I focus on enterprise-wide adoption of Unity Catalog for unified governance, architecting SQL Warehouse workloads, and integrating newer capabilities like Databricks Genie and Databricks Apps to bridge sophisticated data engineering with intuitive business insights.

Which Databricks features are indispensable in your work?

Databricks offers many great capabilities, but for me, the combination of Delta Live Tables (DLT) and Unity Catalog (UC) is the true “secret sauce.”

DLT simplifies operations by handling infrastructure and dependency management, allowing teams to focus purely on data delivery. Meanwhile, Unity Catalog ensures robust security and auditability—vital for industries like banking. Together, they let us scale rapidly while maintaining governance and data quality from ingestion to consumption.

What’s one feature you’d love to see in future updates?

As someone with a strong ETL background using tools like Ab Initio and Informatica, I value local development productivity. I’d love a localized Databricks environment that allows for initial builds and testing on a developer’s machine, integrated with Databricks Assistant. It would make the development feedback loop faster and more iterative.

I’d also like to see Unity Catalog Migration (UCX) tools become smarter. While the current suite is a great start, migrations from legacy Hive Metastore workloads still involve a lot of manual work. More automation here would significantly accelerate large-scale modernization projects.

When did you join the Databricks Community, and what drew you in?

I joined the Databricks Community in 2024, initially as a quiet reader. The richness of technical discussion and enthusiasm of fellow members kept pulling me back. By 2025, I started contributing actively to share my experiences and engage in the conversations shaping the future of the Data Intelligence Platform.

What do you find most valuable about the Community?

The Databricks Community truly embodies an open-source spirit of knowledge sharing. I love how members—from beginners to experts—contribute time and insights to help each other grow. Having direct access to Databricks-related blogs, employee-led articles, and technical deep-dives is incredibly valuable. It’s a space for continuous learning, collaboration, and collective progress.

What do you enjoy doing outside work?

Outside of work, I love spending time with my family and friends. I’m also a sports enthusiast—I regularly play badminton and table tennis at my local sports club whenever I get the chance.

Where do you see yourself in the next three years?

In the next three years, I aim to continue growing in the Architecture domain—building state-of-the-art data platforms that help businesses unlock the full potential of their most valuable asset: data. I strongly believe in the vision of “Democratizing Data For All” and aspire to achieve Databricks MVP status in the near future.

Want to connect with Raman? You can find him on LinkedIn.

Thank you @Raman_Unifeye for sharing your story and for being such a valuable part of our community. We can’t wait to see you achieve your MVP goals and continue inspiring others along the way. Here’s to more learning, sharing, and innovation together! 🚀

Celebrating Our First Brickster Champion: Louis Frolio

Sujitha — Fri, 21 Nov 2025 14:58:21 GMT

Our Champion program has always celebrated the customers who go above and beyond to engage, help others, and uplift the Community. Recently, we have seen remarkable participation from Bricksters as well—and their impact deserves recognition too. Beginning this month, we are excited to introduce the Brickster Champion category, honoring internal teammates who exemplify expertise, generosity, and community spirit.

Meet our very first Brickster Champion - @Louis_Frolio 🌟

Here’s the complete interview, shared in his own words -

Tell us your story: How did your journey with Databricks and the Community begin?

I joined Databricks in January 2020 as a technical trainer, which in Databricks years makes me something of an old-timer. I started by teaching partners, then moved on to customers and eventually internal Field Engineering Bricksters. After nearly six years of teaching, I’ve watched learners build confidence as they unlock more of the platform — and with that progress came a steady stream of questions, many of which stretched beyond the boundaries of training.

Back then, I knew about Community but hadn’t connected it to all those “out-of-scope” questions that surfaced in training. A few years later, the light finally went on. Community became the perfect place to send learners who needed help beyond the classroom — and there was no scope barrier at all. Any question could be asked, and someone would step in to help.

What keeps me coming back is that I’m growing too. Every question teaches me something new or adds nuance to what I thought I already understood. Community helps all of us, and it naturally became part of my daily rhythm and part of how I show up for Databricks learners everywhere.

What sparks your passion? What drives you to keep helping others, sharing knowledge, or solving tough questions here?

At my core, I’m happiest when I’m teaching and helping someone reach that “aha” moment. That’s what pulled me toward this field and what keeps me engaged in the Community. Every question someone asks is a reflection of trust — they believe someone out there is willing to help them get unstuck, and I find that incredibly energizing.

I’m also not only helping Community members; I’m growing and learning, too. With every question, I pick up something new or uncover a nuance in what I thought I already understood. Community helps us all. When I can make someone’s day easier while deepening my own understanding, it feels like I’m giving back to both my customers and Databricks in a meaningful way.

Signature move: Is there a particular topic, technology, or style of contribution that people know you for?

I’ve always enjoyed taking complex ideas and turning them into something clear, structured, and easier to understand. That’s the part of teaching that energizes me the most. Whether I’m helping someone navigate a tricky governance question or clarify a subtle behavior in Spark or Delta, I try to make the hard things feel approachable.

I also have a deep passion for teaching agentic AI and traditional machine learning. These areas are evolving quickly, and I enjoy helping people see how the concepts connect and how they can be applied in practical, real-world ways. Over time, that blend of clarity, structure, and enthusiasm for emerging technology has become what people tend to associate with my contributions in the Community.

A moment that mattered: Can you share one community interaction or success story that truly stayed with you?

One moment that stayed with me came from someone preparing for a Databricks certification who felt overwhelmed and unsure where to start. They weren’t just asking about content — they were looking for clarity, structure, and confidence. I took the time to outline a realistic path forward and point them to the right resources. A few weeks later, they came back excited after passing their exam and grateful for the guidance. It was a reminder that Community is more than a forum. It’s a place where people grow, succeed, and sometimes rediscover what they’re capable of.

Experiences like that also connect directly to another milestone in my Community journey. I was invited to serve as a Founding Fellow for the Databricks Community Fellows Program, a group created to strengthen engagement and accelerate the resolution of questions. Being part of that initiative reinforces why I show up every day: to help build a vibrant, supportive space where learners at all levels can grow.

Behind the scenes: How do you find time to contribute alongside your professional work? Are there any rituals, habits, or motivational hacks?

Contributing to the Community has never felt separate from my role at Databricks. Teaching is my day job, but helping people solve problems is simply who I am. The Community gives me a natural way to continue that work outside the classroom in a meaningful, everyday rhythm.

I usually start my morning by answering a question, and as the day unfolds, I pick up more whenever I have a moment. Some questions require deeper research, while others I can answer from experience. There’s no formal routine — just a steady habit of showing up.

I stay motivated because every question is a chance to help someone move forward while learning something new myself. That virtuous cycle of helping and learning is what keeps me coming back.

Learning in action: What’s something surprising or valuable you’ve learned from the community?

The Community constantly reminds me that insight comes from everywhere. Customers, partners, and enthusiasts ask questions that often reveal new angles, real-world nuances, or creative ways people approach the platform. It’s a healthy reminder to stay curious and open-minded. I’ve learned to approach every question with humility because the mix of experiences in the Community consistently leads to insights that strengthen how we all learn and teach.

Community also gives me a window into how Databricks is being used in the real world. As an instructor, that insight is invaluable. It shapes how I deliver training, what examples I emphasize, and how I prepare learners for the challenges they’re likely to face. Every question becomes both a learning moment for me and a compass that helps me refine my teaching approach.

Tech inspiration: What area of data and AI currently excites you most, and why?

Right now, I’m deeply energized by the rapid evolution of agentic AI. Databricks is on the vanguard of research and technology in this space, and being part of that journey is both exciting and humbling. We’re witnessing a new paradigm emerge — one where intelligent agents can reason, coordinate, and automate complex tasks seamlessly.

I’m in a great position to grow alongside this technology and then share that knowledge with both the Community and the students I teach. What makes this moment in AI exciting for me is how quickly learning turns into doing — and then into helping someone else do the same. That cycle keeps me engaged.

Human side of data: How do you think communities like ours make technical spaces more human and connected?

Communities take something technical and make it feel human. Every question comes from someone trying to solve a real problem, and every answer is someone choosing to help. That willingness to support one another is what turns a forum into a real community.

What makes ours special is the people in it — users helping users, and Databricks employees jumping in when they can. Those interactions build trust and a sense of belonging. It isn’t just about finding the right command or clearing up a concept. It’s about knowing you’re part of a place where everyone is learning and growing together.

Off the keyboard: What do you love doing outside of data and tech?

Before I entered the tech industry, I had a career as a pastry chef. Baking and cooking remain a big part of my life today. I often call it my mindless activity — not because it lacks meaning, but because I can walk into a kitchen and, through muscle memory, produce an array of foods without thinking about the mechanics. There’s real satisfaction in starting with raw ingredients and, a few hours later, having breads, pastries, or savory dishes ready for people to enjoy. My wife especially loves that I cook for her, and I love being the one who gets to make it.

Outside the kitchen, I enjoy spending time with my son, who is studying AI in college. Helping him understand the rapidly changing tech landscape is something I look forward to. It’s a rewarding blend of mentorship, curiosity, and shared exploration. That combination — cooking to reset, teaching to connect, and family to stay grounded — keeps me balanced.

Words to future changemakers: What’s one piece of advice you’d give to someone hoping to make an impact in the Databricks Community?

For me, success has always come from pursuing the things I’m genuinely passionate about and naturally curious to explore. To this day, I chase what interests me and give one hundred percent to that endeavor. That mindset has shaped my growth both personally and professionally and has guided how I show up in the Community.

My advice to anyone looking to make an impact here is simple: chase what matters to you. Follow the topics that spark your curiosity, contribute in ways that feel authentic, and show up willing to learn as much as you teach. When you lean into the things you care about, everything else naturally follows.

Connect with him on LinkedIn: https://www.linkedin.com/in/froliol/

Thank you for your continued support @Louis_Frolio. As you read through his experience, we encourage you to connect with him and learn from his approach to continuous growth and community leadership. His journey sets a great example for anyone looking to make an impact. 🚀

Where It All Began — Databricks Legend: Werner Stinckens, Our First Community Champion of 2022

Sujitha — Thu, 06 Nov 2025 11:52:50 GMT

We’re thrilled to resurface this special post from 2022, celebrating our very first Databricks Community Champion, Werner Stinckens ⭐
This spotlight was one of the earliest Champion features on our platform — it went missing during a content migration, but we’re bringing it back where it belongs.
Werner’s passion, curiosity, and contributions set the tone for what it means to be a Databricks Champion, and his story continues to inspire our community today.

👉 Here’s @-werners- in his own words:

Role: Data Engineer @ Van de Velde

Three words your coworkers would use to describe you:
Helpful, accurate, inquisitive.

What do you enjoy most about your role?
The variety of tasks keeps things exciting, especially tackling unique challenges that come with the fashion industry — like forecasting fashion trends.

What does a typical workday look like?
My top priority is ensuring accurate data is delivered to users on time. That means building and maintaining ETL data pipelines — with Databricks as our core tool.
I also focus on keeping our platform and architecture reliable and future-proof, not just in terms of tools but also in data design. It’s incredible how fast the data landscape evolves!

Do you have any mentors who’ve inspired you?
I wouldn’t say I have formal mentors, but I’ve learned a lot from industry experts such as Andrew Ng, Holden Karau, and mathematicalmonk on YouTube — and from the brilliant minds at AMPLab, especially Matei Zaharia, who sparked my interest in big data.

When did you start using Databricks and join the Community?
I’ve been using Databricks since around 2018 (back when it launched on Azure), though I’d worked with Spark before that.
I joined the Databricks Community as soon as it went live — because a strong community is essential for growth. It’s been amazing to see it expand over the years, and I love seeing new names pop up on the Top Contributors list!

Favorite Databricks features:
Without a doubt — Delta Lake, followed by auto-scaling clusters and Repos.

A feature you’d love to see in the future:
Better IDE integration and more focus on graph processing.

Outside of work:
I’ve been playing guitar for over 30 years and still find joy in improving my craft. I’m part of a band that plays 80s music — it’s a great creative outlet!

Connect with Werner on LinkedIn to follow his data journey and insights! 🚀

Databricks Community Champion - September 2025 - Nayanjyoti Sonowal

Sujitha — Tue, 14 Oct 2025 13:35:50 GMT

We are excited to spotlight Nayanjyoti Sonowal, one of our most active and insightful contributors in the Databricks Community, whose journey reflects the spirit of learning, collaboration, and innovation we value most.

Dive into his story, told in his own words -

Featured Member Introduction

Name: Nayanjyoti Sonowal
Community nickname: @nayan_wylde ⭐
Pronouns: He/His/Him
Company: Major Financial Institution in US
Job Title: Sr. Cloud Engineer

Can you provide a brief overview of your career journey leading up to your current role?
I started my career 15 years ago after graduating in Electrical Engineering, beginning as a Front-End .NET Developer. Over the years, I transitioned through various roles including SQL Server Administrator, Data Analyst, BI Engineer, Data Engineer, Big Data Developer, and Data Architect etc. working across different projects and companies.

Throughout my journey, one thing has remained constant—I’ve always been a data nerd at heart. I’ve consistently gravitated toward roles that involve working with data, and that passion has shaped my entire career.

Around 2018, I made a conscious decision to shift towards cloud technologies, which opened the door to working with Databricks and exploring modern tools and frameworks. This shift broadened my skill set and allowed me to work on more advanced data solutions.

Looking ahead, I’m excited to take my career toward AI, building on my strong data foundation to work with intelligent systems and next-generation technologies.

What do you enjoy most about your current job or role?
What I enjoy most about my current role is that I get to work extensively with Databricks, which is something I’m genuinely passionate about. I’m constantly amazed by how fast Databricks is innovating—there’s always something new happening, whether it’s a feature release, a new capability, or a better way to solve complex data problems.

As someone who’s naturally curious and loves learning, this pace of innovation keeps me on my toes and fuels my excitement every day. I love diving in, experimenting with new tools, and figuring out how to apply them in real-world scenarios. It never feels stagnant—there’s always a new challenge to take on and something exciting to learn.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?
If I had to describe myself in three words, I’d say I’m a fast learner, curious, and hardworking. I enjoy diving into new technologies, understanding how things work, and applying that knowledge quickly to solve real problems.

My coworkers would describe me as humble, a great team player. I believe in collaborating openly, supporting my team, and continuously pushing myself to grow while helping others succeed.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?
Yes, I definitely like to thank two mentors who’ve made a big impact on my career. Jimmy Cooper technical mentor who really helped me deepen my skills and encouraged me to explore new tools like Databricks more confidently. Arvind Ravichandran who shaped how I think professionally they emphasized the importance of curiosity, continuous learning, and giving back to the community. Their guidance has played a huge role in how I approach my work and how I try to support others now.

When and why did you first start using Databricks?
I actually first wrote a small notebook in Databricks back in 2019 to build a simple visualization on a CSV table, but I really started using it actively around March 2020. At that time, I was working as a Data Consultant for a client, and I was asked to perform analysis on COVID data looking at trends and making predictions on how the pandemic might impact different countries.

That’s when I truly discovered the real power of Databricks. It allowed me to process large datasets, collaborate efficiently, and run predictive models all in one place. From that point on, there was no looking back. It became one of my go-to platforms for data work.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
Honestly, all the features in Databricks are great, but if I had to pick, Unity Catalog and Databricks Assistant are my favorites. Unity Catalog really makes it so much easier to discover and manage siloed data everything feels more organized and accessible. And Databricks Assistant has been a game changer for my productivity. It helps me write codes faster, troubleshoot issues, and get things done more efficiently.

Is there a Databricks feature you wish existed or would like to see in future updates?
I’d love to see a lightweight local version of the Databricks runtime - something you could spin up in VS Code that actually behaves like the real thing. Being able to test notebooks locally with actual Spark and Delta Lake without a ton of setup would be huge. Also, it would be great if Databricks Assistant gets even smarter, like suggesting data quality checks or automating common ETL steps. That would make working on the platform even faster and easier.

When did you join the Databricks Community, and what motivated you to do so?
I joined the Databricks Community in December 2022, when I began working more extensively with the Databricks platform and wanted to deepen my understanding beyond the documentation. What truly motivated me was the collaborative and knowledge-sharing culture within the community. I was inspired by how active members supported each other with practical solutions, shared best practices, and discussed real-world use cases.

This year, after meeting professionals at the Community Booth during the Data + AI Summit, I was even more inspired to contribute actively. Engaging with them showed me how valuable the community can be for staying connected with top professionals, learning directly from experts, and keeping up to date with the latest Databricks features and innovations.

What aspects of the Databricks Community do you find most valuable or enjoyable?
What I really enjoy about the Databricks Community is how supportive and collaborative it is. I can find answers to tricky problems quickly, share ideas, and see how other people are solving similar challenges. I like earning badges for contributions and really appreciate the moderators for all the hard work they do to recognize and reward members. It’s also great having access to blogs, tutorials, and forums to learn new skills or see how others tackle challenges. I just hope that in the future there might be some swags for active community members — that would be a fun bonus!

Outside of work, what is your favourite hobby or pastime?
Outside of work, I really enjoy playing tennis and spending time with my rock band over weekend, where I play bass guitar. I also love spending time with my wife, daughter, and our dog — whether it’s going for walks, hanging out at home, or just enjoying family time. It’s a great mix of staying active, being creative, and connecting with the people I care about.

Where do you envision yourself professionally in the next three years?
In the next three years, I see myself becoming even more active in the Databricks community — whether that’s helping other members solve problems, sharing knowledge through technical blogs, or just being part of the conversations that push the community forward. I’d love to present at the Databricks Summit or user group meetups, and I’m also working toward my Databricks MVP journey, which I’m really excited about. I want to keep growing technically while giving back to the community that’s helped me so much.

Want to follow Nayanjyoti’s work and insights?
Find him on LinkedIn and on Medium, where he’s planning to post more blogs and share his learning journey.

Thank you @nayan_wylde for sharing your story and for being such a valuable part of our community. We can’t wait to see you achieve your MVP goals and continue inspiring others along the way. Here’s to more learning, sharing, and innovation together! 🚀

Databricks Community Champion - August 2025 - Benjamin Stringer

Sujitha — Thu, 04 Sep 2025 05:22:39 GMT

We are thrilled to spotlight Benjamin Stringer ( @BS_THE_ANALYST ) as our Databricks Community Champion for August! From teaching mathematics in Jersey to competing internationally as a professional gamer, and now thriving as a data consultant at Bulien, Benjamin’s journey is anything but ordinary. His passion for continuous learning, love for problem-solving, and commitment to helping others make him an inspiring voice in our community.

Read on to learn about his experience, favorite Databricks features, and insights into the future of data platforms.

Featured Member Introduction

Name: Benjamin Stringer 🌟
Community nickname: BS_THE_ANALYST
Pronouns: HE/HIM
Company: Bulien
Job Title: Data Consultant

Can you provide a brief overview of your career journey leading up to your current role?

I’ve had a pretty interesting career path to date. After graduating from university with a maths degree, I trained as a teacher of mathematics and landed a teaching position abroad (I'm from the UK) in Jersey, part of the Channel Islands. After teaching, I decided to reignite a childhood dream of becoming a professional gamer where my team managed to climb the heights of becoming one of the best teams in Europe. As a result, I was fortunate enough to fly across to America to compete in the ALGS global finals for a LAN event! After gaming, I sought some normality, and after conducting my research, I settled on Data, and honestly, that turned out to be one of the best choices I’ve ever made. Initially, I began like most do when pivoting into data, I started with YouTube tutorials, online courses, and trawling through forums to find an appropriate pathway. Shortly after, I found myself enrolled on a Python for Data Analysts bootcamp which showed me the power of code and automation. I wanted to leave Excel behind as fast as possible. I then landed my first data role at a company called Bulien, situated in Newcastle upon Tyne, in the North-East of England, and I’ve been here for almost 3 years. I have loved climbing the ranks at Bulien and now lead the learning & development function, which is a natural fit given my steadfast dedication to education

What do you enjoy most about your current job or role?

As a data consultant, I’ve been engaged with a variety of clients. Fortunately, this provides lots of exposure to so many different problems. It’s allowed me to foster an attitude I’m proud of, which is, “Hey, I might not know the answer, but I’ll certainly do everything I can to learn and find out”. This has helped me grow massively and I love the thrill of getting to a solution. Besides that, it’s my colleagues and the work culture. I’m surrounded by passionate individuals who push me to be the best version of myself.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?

Passionate. Competitive. Hungry (in both knowledge and foodconsumption). My coworkers would describe me as an unwavering nerd.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?

Three, to date.

First, Alex, a dear friend from university who was a classmate throughout my maths degree. Thanks to Alex, I was the highest overall achiever in both my second and third years. This wasn’t because I was the smartest; Alex was one of (if not) the smartest in my year group. I learned a lot from him and his attitude towards studying. My approach to scoring higher than him was to do extra work outside of his schedule (cunning, I know). In reality, that meant I didn’t even go home for Christmas break. The sacrifices we make in the face of defeat.

Second, my work colleague at Bulien, Owen “TheOC” Coyle. He was and continues to be my mentor (even if he doesn’t officially call himself my mentor). Owen is somebody who isn’t afraid to fail, lifts others around him, and ensures he makes time for people. This has been a big factor in helping me accelerate my career path in the Data world and has shown me the value that being an active community member can bring.

Third, my wife-to-be, Ria. I don’t need to say much more than she’s been here for the whole ride. Moving countries, swapping careers, and starting from scratch brings hardship with it. Somehow, she thrived in the chaos and taught me that change is something to embrace. Nothing can match the confidence that you have in the decisions you make if you have somebody who backs you.

When and why did you first start using Databricks?

I first started using Databricks back in January of this year. Although it had been on my radar for a while before that! I started using Databricks through a combination of clients using Databricks and the partnership with Alteryx. I’ve never been more excited for the future. Databricks is unreal!

Are there any Databricks features that you particularly enjoy or find indispensable in your work?

For me, it’s the flexibility that Databricks’ Notebooks bring. The fact that you pick SQL, R, Scala, or Python - all in a single place, by the way! just blows my mind.

Is there a Databricks feature you wish existed or would like to see in future updates?

It’s the Databricks Free Edition. It’s such a game-changer for anyone looking to get started with Databricks. I appreciate that its predecessor, “Community Edition”, was around before this, but the Free Edition brings all the latest and greatest features!! I wish it had been around when I first started learning, but I’m so happy for others that it’s around now. The cloud can feel daunting, especially when you’re worrying about running up costs, but the Free Edition takes that stress away and gives people a safe space to learn, experiment, and really grow.

When did you join the Databricks Community, and what motivated you to do so?

The sheer passion and energy around this product made me realise I needed to get involved with the other superstars who are using it. I joined back in January, and I wish I had joined sooner! The community lived up to what I hoped for & I’m loving the direction that it’s moving in. I know it’s bold to say, but I’m really excited to master the product… I may regret saying this (future me, don’t laugh). The community members on Databricks are awesome, I’m learning so much from them & I can’t wait to provide as much value back as possible. This really is going to be such an exciting journey.

What aspects of the Databricks Community do you find most valuable or enjoyable?

I love the gamification with levels and badges. Before working in data, I was a professional gamer! I’m a sucker for ranking up. Every day, I’m learning more and more from the community members. It’s already clear to me that the community staff listen to the community users and that really matters. It’s something I’m proud to be a part of! Thanks to everyone who’s helping create such a great space.

Outside of work, what is your favourite hobby or pastime?

I love learning, currently that consists of mastering Databricks and doing everything I can to become a great data engineer. When life calls for me to go outside, I enjoy hiking and putting myself through my paces. My fiancée and I have recently climbed a mountain called Helvellyn and hiked across the neck of England on a route called “Hadrian’s Wall”.

Where do you envision yourself professionally in the next three years?

I envision:
- Becoming a respected Data Engineer and voice in the community. - Building a strong and current understanding of AI, specifically through the lens of Databricks.
- Achieving all Databricks certifications.
- Staying consistent in the Databricks community and achieving the status of an MVP. - Speak at Databricks events.
It’s important to me that I can grow with the Databricks community and give back as much as I can to others along the way.

🌟 @BS_THE_ANALYST AKA Benjamin’s story is a reminder that diverse experiences fuel innovation and growth — both in data and in life. We are proud to have him as an active contributor, and we can’t wait to see him achieve his goal of becoming an MVP and speaking at Databricks events.

Join us in congratulating Benjamin, check out his Alteryx ACE profile to see more of his work and follow his journey on LinkedIn, 🚀

Databricks Community Champion - April 2025 - Brahma Reddy

Sujitha — Fri, 02 May 2025 14:57:56 GMT

This month, we are excited to spotlight our April Community Champion, Brahma Reddy (@Brahmareddy), Lead Data Engineer at Delta! 🎉

Brahma is a passionate problem-solver who has made impactful contributions in the Databricks Community through knowledge sharing and consistent engagement. We asked him a few questions about his journey, inspirations, and favorite Databricks features—and here’s what he had to say, in his own words.

Featured Member Introduction

Name: Brahma Reddy 🌟
Community nickname: @Brahmareddy
Pronouns: He/Him
Company: Delta
Job Title: Lead Data Engineer

Can you tell us about your career journey?
I started my career as a software developer. But very soon, I got interested in working with data. I found it exciting to understand how data can help solve problems and guide decisions. So, I moved into data engineering and worked on different projects in areas like healthcare, airlines, and HR. I learned how to build data pipelines, fix data issues, and work with big data. Now, I lead a team and use cloud tools like HANA, AWS and Databricks to design systems and solve real-world problems using data.

What do you enjoy most about your current job?
I enjoy solving problems and helping my team grow. I like creating smart and simple data systems that others can use easily. It makes me happy when our work helps others make better choices using the data we provide. I also enjoy learning new things and sharing what I know with my team.

How would you describe yourself in three words?
Curious, focused, and helpful.
My coworkers might say I’m calm, supportive, and dependable.

Have you had any mentors or people who inspired you?
Yes, I’ve been lucky to have good mentors in my journey. They trusted me, gave me new challenges, and let me try new ideas. I learned a lot from them. I also follow people in the tech world who share their knowledge and create useful tools. Their work inspires me to do more and share what I know too.

When did you first use Databricks and why?
I started using Databricks a few years ago when we needed a better way to manage big data. We were facing performance issues, and Databricks helped us fix them easily. It was simple to use, saved us time, and allowed us to scale our pipelines. Since then, it’s been my favorite tool for data engineering.

What are your favorite Databricks features?
I really like Delta Lake—it keeps our data clean and trustworthy. The Databricks Assistant is super useful for saving time and fixing code. Unity Catalog is another great feature. It helps manage who can see what data, which is very helpful when working with large teams.

Is there a feature you wish Databricks had?
Yes! I would love a smart feature that suggests how to improve Spark jobs by looking at past runs. Also, having a built-in dashboard to track system health and performance would be very useful. It would make it easier to spot issues early and fix them quickly.

When did you join the Databricks Community, and why?
I joined the Databricks Community in early 2024. At first, I wanted to learn more and stay up to date. Then I saw how friendly and helpful the community is. That made me want to contribute too. I started answering questions and sharing what I’ve learned. It’s a great place to learn and help others.

What do you like most about the Databricks Community?
The people are the best part! Everyone is kind, helpful, and willing to share what they know. You can ask questions, learn new things, and even make friends. It feels like a big family of data lovers who are all growing together.

What do you enjoy doing outside of work?
I love dancing! It helps me relax and feel happy. I also enjoy writing blogs about data and technology. I like explaining things in simple words so others can learn easily. Sharing knowledge gives me a lot of joy.

Where do you see yourself in three years?
In three years, I want to become a cloud data expert and also help more people learn. I want to keep improving my skills in AWS, Databricks, and data engineering. I’m also planning to build a learning platform for kids who don’t have access to good computer education. I believe that learning computers early in life can open up many opportunities. I’ll continue writing blogs to help beginners understand data better. My goal is to be someone who builds smart data systems and helps others grow through learning.

Thank you, Brahma, for sharing your story and for being such an active part of our Community! Your passion for learning, mentoring, and simplifying data engineering for others truly makes you a champion. We are grateful to have you in the Databricks Community and can’t wait to see what you do next.

Be sure to connect with Brahma on X (Twitter) and keep an eye out for his upcoming blogs and insights. 🚀

Databricks Community Champion - March 2025 - Takuya Omi

Sujitha — Mon, 31 Mar 2025 14:15:08 GMT

Meet Takuya Omi (尾美拓哉), a passionate Data Engineer at NS Solutions and a valuable member of the Databricks Community. Takuya's career journey began in the marketing division of a financial institution, where his early work with SQL and machine learning sparked a deeper interest in data engineering. Today, he plays a key role in helping clients build impactful Lakehouse platforms, turning data into business value.

Featured Member Introduction

Name: Takuya Omi(尾美拓哉)
Community nickname:Takuya-Omi
Pronouns:He/Him
Company:NS Solutions
Job Title:Data Engineer

We presented him with a range of questions, and below, you will find his responses, expressed in his own words:

Can you provide a brief overview of your career journey leading up to your current role?
I began my career in the marketing division of a financial institution, working as a data analyst. Initially, I performed basic analytical tasks using SQL, but I soon started developing machine learning models to gain deeper business insights. However, our analytics infrastructure was still quite immature, and I often struggled with data quality issues. This experience sparked my interest in data engineering, and about three years ago, I transitioned into a career as a data engineer.

What do you enjoy most about your current job or role?
I currently serve as a consulting partner for Databricks, supporting clients across a wide range of industries in building Lakehouse platforms. It’s incredibly rewarding to see how data on those platforms is then leveraged to create genuine business value, as it reaffirms that I’m making a meaningful contribution to their success.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?
This was a difficult question for me, so I decided to consult my boss. She described me as “curious”, ”dedicated” , and “polite”.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?
I’ve had the privilege of working alongside many professionals whom I deeply respect. One of my first managers introduced me to a fantastic tool called Terraform, which we now use for nearly all of our Databricks environment setups. Another manager taught me the principles of system troubleshooting. Both individuals have had a profound influence on my career.

When and why did you first start using Databricks?
I first came across Databricks when I was working as a data analyst and constantly battling out-of-memory issues while handling Pandas dataframes in a Jupyter　notebook. Today, I use Databricks on a daily basis in my work.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
Databricks Assistant is fantastic—it’s an indispensable companion in my day-to-day development.

Is there a Databricks feature you wish existed or would like to see in future updates?
As a data engineer, I’m eagerly awaiting the GA release of Databricks Lakeflow because I’ve spent a great deal of time and effort moving data from various sources into object storage, and I believe Lakeflow Connect will be a game-changer for tackling those challenges.
Additionally, I’m keeping a close eye on developments in Delta Live Tables, which currently has a few shortcomings—though I won’t go into the fine details here. However, I’m confident these will be resolved once Delta Live Tables evolves into LakeFlow Pipelines.

When did you join the Databricks Community, and what motivated you to do so?
I joined in October 2023. At first, I simply browsed the posts and discussions from other community members. However, as my knowledge of Databricks grew, I felt a strong desire to contribute myself. Recently, I’ve been challenging myself to tackle more difficult questions by researching thoroughly and then providing answers.

What aspects of the Databricks Community do you find most valuable or enjoyable?
I find it remarkable that, no matter the question, knowledgeable community members quickly notice and offer their insights. I hope to see the community become even more active, allowing valuable knowledge to accumulate in a virtuous cycle—and I’m eager to play a part in making that happen.

Outside of work, what is your favourite hobby or pastime?
On weekends, I enjoy programming while sipping my favorite wine. I do occasionally wake up the next morning to discover I’ve produced some rather questionable code under the influence!

Where do you envision yourself professionally in the next three years?
I’d like to step into a role often referred to as a technical evangelist or advocate, promoting the value of Databricks’ Lakehouse platform. Achieving this will require me to stay up to date on Databricks’ rapidly evolving technology and gain even more hands-on success stories with Lakehouse implementations.

Social Media Handles
Linkedin: https://www.linkedin.com/in/takuya-omi/

Takuya’s dedication to growing the Databricks Community and his goal of becoming a technical evangelist reflect his drive to make a lasting impact. We are excited to see how his expertise and passion will shape the future of data engineering! 🚀

Make sure to connect with him to learn more about his experience and insights.

Databricks Community Champion - February 2025 - Stefan Koch

Sujitha — Tue, 04 Mar 2025 08:12:03 GMT

Meet our Databricks Community Champion, Stefan Koch! ⭐ From a career in law enforcement to becoming a Principal Solution Architect at b.telligent, Stefan’s journey is nothing short of inspiring.

Read on to learn about his experience, favorite Databricks features, and insights into the future of data platforms!

Name: Stefan Koch
Community nickname: @Stefan-Koch
Pronouns: He/Him
Company: b.telligent
Job Title: Principal Solution Architect

Can you provide a brief overview of your career journey leading up to your current role?
I actually ended up in my role as a consultant and architect rather late in life. A very long time ago, I studied to be a machine mechanic. I then worked for 15 years as a police officer, IT forensic scientist and cyber investigator before joining Trivadis in Switzerland as a consultant in business intelligence. After Trivadis, I worked at Accenture as a consultant and architect before joining b.telligent in January 2024. I now have the role of Principal Solution Architect and drive the topic of Databricks within b.telligent and with my customers.

What do you enjoy most about your current job or role?
I like to plan, build and operate data platforms and architectures for various customer projects. I can also advise new customers on choosing a suitable technology and train them on Databricks, for example. I also like to support younger colleagues so that they become more familiar with Databricks and other modern technologies.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?
Curious - I love learning new things and solving problems creatively.
Reliable - When I tackle something, I do it properly. My colleagues know that they can rely on me.
Humorous - I think a bit of humor is always part of it - even in the most technically dry meetings.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?
Yes, Marco Amhof was my mentor at Trivadis and I learned a lot from him. In the meantime, he has become a very good friend.

When and why did you first start using Databricks?
I worked with Databricks for the first time in 2019. Back then, the whole platform looked a bit different 😉

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
There are several features that I would no longer do without today. But honestly, one of the best features overall is Unity Catalog. It makes your life so much easier.

Is there a Databricks feature you wish existed or would like to see in future updates?
I wish we had (even) more options for integrating on-prem data sources. An agent or self-hosted integration runtime like Azure Data Factory, but based on Databricks, that would be cool. That would be the last mile, so to speak, where I only have to set up Databricks 100% and can cover all use cases.

When did you join the Databricks Community, and what motivated you to do so?
Although I have been using Databricks for a long time, I joined the community late. I was at the Databricks Data & AI Summit in San Francisco last summer and then created my account. I wanted to stay more up to date with what's on people's minds, what new features are, what other people are working on.

What aspects of the Databricks Community do you find most valuable or enjoyable?
I think it's great that you can find an active community here where people help each other. If I have a problem or a challenge, I can either find the answers here or ask the questions, which are then answered promptly.

Outside of work, what is your favourite hobby or pastime?
I teach and lead 2 CAS courses at the Lucerne University of Applied Sciences and Arts. Of course, this also requires free time, which I invest. Apart from that, I try to spend as much time as possible with my wife and my two little girls. We like to travel and spend a lot of time in the mountains, hiking in summer and skiing in winter.

Where do you envision yourself professionally in the next three years?
Good question 🙂 In any case, I still see myself at b.telligent because it's simply a cool company.
I would like to see myself even more in the role of a mentor, so that I can pass on my knowledge to younger colleagues. Who knows, maybe I'll become an author and write a book?

Social Media Handles
You can find me on Linkedin: https://www.linkedin.com/in/stefan-koch/ or on Mediumhttps://medium.com/@stefanko-ch, I publish an article from time to time as soon as time permits. For this year, I have resolved to blog regularly.

Stefan’s passion for learning, mentoring, and problem-solving truly shines through! 🚀
We wish him continued success in his journey and look forward to seeing his contributions in the Databricks Community. Want to connect with him or have questions? Drop a comment below and keep the conversation going! ⬇️

Databricks Community Champion - December 2024 - Sujesh Menon

Sujitha — Thu, 05 Dec 2024 10:36:27 GMT

Meet Sujesh Menon, a valued member of our community! Sujesh is a Senior Data Engineer at Glanbia, Plc. He brings a wealth of knowledge and expertise to the group, and we are thrilled to have him here.

We presented him with a range of questions, and below, you will find his responses, expressed in his own words -

Name: Sujesh Menon
Community nickname: @menotron ⭐
Pronouns: He/Him
Company: Glanbia, Plc
Job Title: Sr. Data Engineer

Can you provide a brief overview of your career journey leading up to your current role?

With a background in Electronics and Telecommunications engineering, I joined Reliance Jio Infocomm as a Graduate Trainee back in 2016 but soon got the opportunity to be part of the newly formed Big Data CoE in the capacity of a Data Engineer and my career pivoted as I fell in love with everything data and analytics. During my stint with Jio, I got to work with one of India’s largest data lake crunching petabyte scale data across a breadth of technologies in the HDP stack and that is where I honed my Data Engineering skills. Still, remember binge reading spark 1.6 documentation.
I later moved to Ireland in 2019 to pursue master's from Trinity College, Dublin focusing on Distributed Computing. Upon graduating I first worked with Zalando, building platform codebase and data pipelines and this was where I was introduced to Databricks and have been a fanboy of the platform ever since.

In my current role with Glanbia Plc, I am responsible for the data engineering function and have been working on some really cool projects leveraging a modern tech stack and helping the business on their digital transformation journey.

What do you enjoy most about your current job or role?
This list could be quite long. But mainly the autonomy and the opportunity to contribute to some really innovative projects including a few GenAI applications. The ability to be an advocate and practitioner of strong data governance principals. I find a sense of satisfaction to be able to leverage my expertise in building data solutions across cross functional teams wearing multiple hats and see the impact of my work in a transparent way.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?

Ah! time for self-reflection.. I’d like to describe myself as Analytical, Curious and Resilient.

I hope my coworkers describe me as a result oriented and reliable colleague who is approachable and can get things done no matter what.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?

I consider myself to be fortunate to have some really good mentors and managers all along my career. Special mention to Nilesh Mahajan, Naresh Chhabria, Rohan Naidu and Mark O'Gara.

Beyond their technical skills, it’s their work ethics, problem solving and management that I value the most. More than the mentoring and support it was their trust and autonomy that has allowed to take up ownership and push myself to grow in my career.

Outside work, the people who have inspired and have had significant influences in my professional life would include Jacek Laskowski, Denny Lee, Maxime Beauchemin, Pierre Villard, Tathagata Das to name a few.

When and why did you first start using Databricks?
Even though I had tried Databricks Community Cloud sometime back in 2019, it was during my stint with Zalando when I first started using it in a prod setup. But more as a compute infra to submit jobs from our Airflow workflows. In my current organization, we use it to the full extend and pretty much leverage all capabilities of the Data Intelligence Platform including ETL, data warehousing, BI and AI.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
I would have to say Workflows and unity catalog as they have made life so much easy.

With the advent of AI, the need to have a unified governance is paramount and databricks Lakehouse has made it possible to build and deliver projects with strong governance and security while adhering to ML and Data Ops practices.

Lately, I have been playing with the Apps feature that’s in preview and believe it is a game changer.

Is there a Databricks feature you wish existed or would like to see in future updates?
Native connectors to SAP ERP systems under Lakehouse federation would be super nice as I believe both companies are now strategic partners advocating an Open Data Ecosystem.

Secondly, even though I like drowning in system tables, it would be really handy have to have a better visual representation of the telemetry and observability aspect. Something like an admin insights dashboard.

Also, I am super excited to try out the LakeFlow Connect when it becomes available on our account.

When did you join the Databricks Community, and what motivated you to do so?

I have been a member since May, 2023. Initially joined just to stay updated about any events or meetups happening near me. But have found it to be a great place to expand my knowledge. And before I befriended the databricks assistant, I have almost always found solution to a problem I was facing here on the community forum. So, it only seemed fair for me to do the same.

It is rewarding feeling to be able to solve a problem and contribute in the community.

What aspects of the Databricks Community do you find most valuable or enjoyable?

This is one of the most active community I am associated with. The one aspect I find the most valuable is the promptness and multi-faceted approach to a problem as not only the employees but other community members with varying backgrounds and expertise engage in the conversations.

Can’t thank enough to all those people who spare time to answer on the forums and especially the community managers for fostering this space and sharing frequent updates while moderating and ensuring the community grows.

Outside of work, what is your favorite hobby or pastime?
I enjoy tinkering with hobby electronics and pretend to make music on my DAW.

I recently got married so, lately it’s all about spending quality time with my better half and living this phase of life to the fullest.

Where do you envision yourself professionally in the next three years?

From a career progression point of view, I aspire to become the principal engineer with strong expertise in architecting scalable AI solutions for the business. I would also love to be able to mentor and contribute back to OSS.

Social Media Handles
Linkedin: https://www.linkedin.com/in/sujesh-menon-1010/

Thank you for sharing your personal and professional journey with us. We appreciate the opportunity to learn from your experiences @menotron. 🌟

Come, let's embark on a journey celebrating the experiences of our Community members. Make sure to connect with him to learn more about his experience and insights in the data engineering space! Your next source of motivation awaits with just a scroll! 🚀

Databricks Community Champion - October 2024 - Filip Niziol

Sujitha — Mon, 04 Nov 2024 10:24:47 GMT

Meet Filip Niziol, a Senior Data Engineer at Digiterre and an active contributor to the Databricks Community. With a rich background in data architecture and a passion for building scalable data solutions, Filip shares insights on his career, Databricks journey, and what motivates him to stay engaged with the community.

We presented him with a range of questions, and below, you will find his responses, expressed in his own words -

Featured Member Introduction

Name: Filip Niziol
Community nickname: @filipniziol ⭐
Pronouns: He/Him
Company: Digiterre
Job Title: Senior Data Engineer

Can you provide a brief overview of your career journey leading up to your current role?

I have 15 years of experience, starting on the business side before moving into IT. I've played various roles including BI Analyst, Data Warehouse Developer, SQL Developer, Digitization Expert, Data Engineer, and Data Architect. I am project-focused, and for many years I've been working as a consultant with the ability to build end-to-end projects from scratch.

At BP, as a Data Pipeline Engineer, I developed data pipelines in the finance area using Azure Databricks, Data Factory, and Data Lake. This role enhanced my expertise in Azure technologies and large-scale data processing.

Currently, at Digiterre, I leverage my extensive experience to build robust data solutions.

What do you enjoy most about your current job or role?

I enjoy the opportunity to work on a recently initiated project where I can set standards and build patterns that will be followed by multiple teams in the future. Building stable data pipelines with self-recovery features is particularly satisfying. The sheer volume of data we handle makes the work challenging and exciting.

By contributing to the foundational architecture, I have a direct impact on the project's success and the efficiency of future developments. It's rewarding to know that the frameworks and best practices I'm establishing will support the organization's growth and help my colleagues succeed in their roles.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?

Myself in three words: Analytical, Innovative, Determined.

Coworkers might describe me as Reliable, Collaborative, and Knowledgeable.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?

Absolutely. My first mentor was Michal Gogolewski, the Chief IT Specialist at Mary Kay Cosmetics. He introduced me to database engineering and encouraged me to delve deeper into the IT world. Later, at PGE Systemy S.A., I had the privilege of working with experts in data warehousing who taught me best practices and allowed me to express my creativity within the Innovation and Digitization Department led by Maciej Chojnacki. Throughout my career, I've been fortunate to learn from many talented individuals, and currently, at Digiterre, I'm inspired daily by my exceptional colleagues.

When and why did you first start using Databricks?

I started working with Databricks over three years ago while at Lingaro as an Azure Data Architect. We needed a robust platform for processing large volumes of data efficiently, and Databricks was the perfect solution. Since then, I've been using Databricks in all of my projects due to its scalability and seamless integration with Azure services.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?

Yes, I particularly appreciate Databricks Asset Bundles (DABs). They simplify the deployment process significantly. In one of my previous projects where DABs weren't used, we had a separate DevOps team to handle deployments. With DABs, the development team can take ownership of managing configuration and maintenance, streamlining the workflow.

I also love the AI Assistant. I use it extensively to write code, and it's incredibly helpful on the Databricks Community forum when preparing end-to-end code samples with ready-to-use code while answering questions.

Is there a Databricks feature you wish existed or would like to see in future updates?

I'd like to see more features added to Databricks Live Tables, such as more robust logging capabilities and the ability to define target columns that should be inserted but not updated in subsequent runs. These enhancements would provide greater control and transparency in data processing workflows.

When did you join the Databricks Community, and what motivated you to do so?

I joined the Databricks Community earlier this year. I was inspired by Szymon Dybczak, who became a Databricks Community Champion the previous month. Observing his extensive in-depth knowledge made it clear that participating in the community is an excellent way to learn a lot in a short time. His involvement motivated me to engage with the community actively.

What aspects of the Databricks Community do you find most valuable or enjoyable?

I enjoy preparing end-to-end solutions, where I start with some test data and work through to the final output. Challenging myself by solving questions in areas I'm not familiar with helps me learn new things and stay updated with the latest technologies.

Contributing to the community allows me to connect with other professionals in the field, expanding my network and exchanging knowledge. I'm someone who sets personal goals; my current goal is to earn the badge for 100 Best Answers on the community forum. Participating not only helps others but also enhances my own understanding and expertise.

Outside of work, what is your favourite hobby or pastime?

I'm passionate about South America and Latin dance, specifically reggaeton. Living in Warsaw, I attend reggaeton dance classes regularly. In January of this year, I spent time as a digital nomad in Medellín, Colombia, where I met local musicians and even recorded a music video with them. Since then, I've been developing my alter ego, Filip Flow, and I'm preparing to record a new song next year. This creative outlet allows me to express myself artistically and brings balance to my professional life.

Where do you envision yourself professionally in the next three years?

I aim to become more involved in AI development because I believe AI is transforming the data engineering landscape. Having completed the Databricks Academy Generative AI Developer course, I'm now starting a third-party course on building AI Agents. I plan to integrate AI solutions into my work to drive innovation and efficiency.

Continuing my journey with Databricks, my ultimate goal is to become a Databricks MVP. I'm also looking forward to attending the Data + AI World Tour 2024 in Madrid this November, where I hope to meet the Databricks team in person and connect with other professionals in the field.

Social Media Handles
Linkedin: https://www.linkedin.com/in/filip-nizio

Thank you, Filip, for sharing your inspiring journey and insights with us! From pioneering data solutions to sharing knowledge through the community, Filip exemplifies the spirit of collaboration and growth. We're excited to see his continued impact as he works toward his goal of becoming a Databricks MVP! 🚀

Join us in celebrating our Community Champions—connect with @filipniziol to dive deeper into his expertise and gain fresh motivation for your own data journey! 🌟

Databricks Community Champion - September 2024 - Szymon Dybczak

Sujitha — Tue, 01 Oct 2024 16:02:35 GMT

Meet Szymon Dybczak, a valued member of our community! Szymon is a Senior Data Engineer at Nordcloud. He brings a wealth of knowledge and expertise to the group, and we're thrilled to have him here.

We presented him with a range of questions, and below, you will find his responses, expressed in his own words -

Name: Szymon Dybczak 🌟
Community nickname: @szymon_dybczak
Pronouns: He/Him
Company: Nordcloud
Job Title: Senior Data Engineer

Can you provide a brief overview of your career journey leading up to your current role?

I started my career as a data engineer in 2017, initially focusing on the maintenance and development of a large data warehouse for a leading energy company in Poland. This experience gave me a solid foundation in working with complex data architectures.

Later, I decided to shift toward cloud technologies, specifically Azure, which led me to my first encounter with Databricks and the concept of Lakehouse architecture. Since then, I have been expanding my expertise in cloud-based data solutions, leveraging modern tools and frameworks to optimize data processing and storage.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?

If I had to describe myself in three words, I would choose adaptable, fast learner, and goal-driven. I’m not afraid of new challenges and always strive to find innovative solutions.

I believe my coworkers would describe me as a reliable team player who is always ready to support the team, a problem solver who enjoys tackling complex tasks, and someone who tries to bring a positive attitude to the workplace.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?

Yes, I’ve had several significant influences throughout my career. In a previous job, I was fortunate to work with a group of colleagues who had a huge impact on my professional growth. From them, I learned a lot about development approaches, best practices, and problem-solving techniques. We shared knowledge freely, which helped me sharpen my skills and adopt more effective strategies for handling complex projects.

This collaborative environment had a lasting effect on how I approach my work today. It emphasizes the importance of teamwork, continuous learning, and applying best practices in every project.

When and why did you first start using Databricks?

I first started using Databricks about 3 year ago when my team was tasked with handling large-scale data processing for a cloud-based project. We chose Databricks primarily due to its powerful ability to process big data efficiently and its seamless integration with Azure. One of the key reasons was the platform's flexibility—it supports multiple programming languages like Python, Scala, and SQL and collaborative experience thanks to notebooks, which allowed us to leverage the best tools for different tasks.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?

Yes, several Databricks features are particularly useful in my work. One of them is Databricks Autoloader, which significantly simplifies the process of loading data incrementally. This has been a game-changer for keeping our data pipelines running smoothly and efficiently.

Another key feature I frequently rely on is Databricks Workflows, which helps automate and orchestrate complex data. I’m especially excited about the recent addition of the for each loop task, which allows for better control over iteration within workflows, improving automation and reducing manual intervention.

Is there a Databricks feature you wish existed or would like to see in future updates?

Yes, I would like to see further improvements and additions to Databricks Workflows. I’m also looking forward to Attribute-Based Access Controls in Unity Catalog.

When did you join the Databricks Community, and what motivated you to do so?

A colleague introduced me to the Databricks Community, and since then, I have found it to be a great place to develop my skills and expand my knowledge of the product by helping fellow developers.

What aspects of the Databricks Community do you find most valuable or enjoyable?
One of the most valuable aspects of the Databricks Community is the opportunity to connect with experienced developers who share their knowledge and experiences. It’s an excellent environment for expanding my understanding of the platform and learning best practices.

I also find great satisfaction in helping others within the community. Helping colleagues in the community not only reinforces my own learning but also provides a rewarding sense of contribution.

Outside of work, what is your favourite hobby or pastime?

Outside of work, I enjoy several hobbies. I’m a big fan of football and support Chelsea London, so I love following their matches and celebrating their successes. I also enjoy hiking in the mountains, which allows me to connect with nature and stay active. Recently, I’ve started playing tennis, which has been a fun new challenge and a great way to stay fit.

Where do you envision yourself professionally in the next three years?

In the next three years, I envision myself deepening my expertise in Databricks as a product. I aim to build more Lakehouse architectures and expand my knowledge in data management and cloud technologies. Additionally, I would like to mentor others in the community, sharing my insights and experiences to help them grow in their careers as well.

Social Media Handles
Linkedin: https://www.linkedin.com/in/szymon-dybczak/

Thank you for sharing your personal and professional journey with us. We appreciate the opportunity to learn from your experiences @szymon_dybczak 😊🌟

Featured Member Interview - August 2024 - Rishabh Pandey

Sujitha — Mon, 09 Sep 2024 07:55:22 GMT

Featured Member Introduction

Name: Rishabh Pandey
Community nickname: @Rishabh-Pandey
Pronouns: He/Him
Company: Celebal Technologies PVT LTD
Job Title: Associate Consultant – Data Engineer

Can you provide a brief overview of your career journey leading up to your current role?

With a solid foundation in computer science, I embarked on my career as a data engineer three years ago, focusing on building and optimizing data pipelines. Initially working with relational databases and SQL, I quickly transitioned to handling big data technologies such as Apache Spark and PySpark. My role involved designing and implementing scalable ETL pipelines, where I leveraged Python for scripting and automation. I also gained hands-on experience with Azure Databricks, using it to manage Spark clusters and perform advanced data analytics. Additionally, I utilized Azure Data Factory (ADF) to orchestrate data workflows and ensure seamless data integration across various platforms. Throughout my career, I have successfully improved data processing performance and contributed to cross-functional projects, continuously expanding my skill set through certifications and training to stay at the forefront of data engineering.

What do you enjoy most about your current job or role?

In my current role, what I enjoy most is the opportunity to work with cutting-edge technologies and solve complex data challenges using Azure Databricks. I find it incredibly rewarding to design and optimize scalable data pipelines that handle large volumes of data efficiently. The collaborative nature of Databricks, with its integrated environment for data engineering and analytics, allows me to work closely with team members and stakeholders to deliver impactful data solutions. I also appreciate the continuous learning aspect of my job, as it keeps me engaged with the latest advancements in big data technologies and enables me to constantly improve my skills. The satisfaction of seeing data-driven insights drive business decisions and improvements is a significant motivator for me.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?

If I had to describe myself using three words, they would be innovative, detail-oriented, and collaborative. I believe my coworkers would describe me, similarly, highlighting my ability to bring fresh ideas to the table, my meticulous approach to problem-solving, and my positive, team-focused attitude that fosters a productive and supportive work environment.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?
Yes, I’ve been significantly influenced by several key figures in big data engineering. A senior data engineer early in my career provided crucial mentorship on Apache Spark and Azure Databricks. I've also been inspired by Matei Zaharia, the creator of Apache Spark, for his impact on distributed data processing, and Jeffrey Dean for his contributions to scalable computing. Additionally, Ali Ghodsi, CEO of Databricks, has greatly influenced my work with his innovations in big data and cloud technologies. Their insights and leadership have profoundly shaped my approach to data engineering.

When and why did you first start using Databricks?

I first started using Databricks in 2022 when my team sought a more efficient way to handle our large-scale data processing and analytics tasks. We needed a platform that could seamlessly integrate with Apache Spark, which we were already leveraging, and provide enhanced capabilities for data transformation and collaboration. Databricks was an ideal choice due to its unified environment, which simplified cluster management, optimized performance, and fostered better teamwork through its collaborative notebooks. Its integration with Azure further aligned with our cloud-based infrastructure, making it a pivotal tool in our data engineering toolkit. Since then, Databricks has significantly streamlined our data workflows and improved our ability to generate valuable insights.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
In my work with Databricks, two features that stand out as particularly valuable are Delta Live Tables and serverless compute.

Delta Live Tables revolutionize the way we manage and process data pipelines. This feature simplifies ETL workflows by automating data pipeline management, ensuring data quality, and providing built-in data monitoring. Delta Live Tables allows for more efficient development and maintenance of data pipelines, with real-time updates and a simplified approach to handling streaming and batch data. It significantly reduces the operational overhead associated with managing complex data workflows and enhances the reliability of our data processing.

Serverless Compute is another indispensable feature that I greatly appreciate. It abstracts away the complexity of managing and provisioning clusters, allowing us to focus on data processing and analytics without worrying about the underlying infrastructure. With serverless compute, we can scale resources up or down automatically based on our workload requirements, optimizing both performance and cost. This feature provides flexibility and efficiency, enabling us to handle varying data processing demands seamlessly.

Is there a Databricks feature you wish existed or would like to see in future updates?

One feature I’d love to see in future Databricks updates is advanced data lineage tracking. While Databricks offers great tools for managing and transforming data, having more robust, visual data lineage capabilities would greatly enhance our ability to trace data flow through complex pipelines, understand dependencies, and troubleshoot issues more effectively. This would improve transparency and ensure better data governance across our workflows.

When did you join the Databricks Community, and what motivated you to do so?

I joined the Databricks Community in 2022. My motivation for joining was to connect with other professionals in the field, stay updated on the latest developments, and leverage shared knowledge to enhance my work with Databricks.

What aspects of the Databricks Community do you find most valuable or enjoyable?

What I find most valuable about the community is the opportunity to engage with a network of experts and peers who share insights, best practices, and solutions to common challenges. The forums, webinars, and collaborative discussions provide a wealth of resources and support that are incredibly beneficial for continuous learning and problem-solving.

Outside of work, what is your favourite hobby or pastime?

Outside of work, my favourite pastime is running my YouTube channel, where I focus on teaching Databricks and mentoring professionals in data engineering. I enjoy creating content that helps others understand complex data concepts and effectively use Databricks tools. It’s rewarding to see viewers grow their skills and apply new knowledge in their work. This channel allows me to stay engaged with the data engineering community and share my passion for technology and learning.

Where do you envision yourself professionally in the next three years?

In the next three years, I envision myself advancing to a senior role in data engineering, where I can lead larger projects and drive innovation within the field. I aim to deepen my expertise in emerging technologies and continue leveraging platforms like Databricks to solve complex data challenges. I also see myself representing Databricks across the globe, participating in conferences, and engaging with the global data engineering community. Additionally, I plan to contribute to strategic initiatives, mentor junior team members, and expand my influence through thought leadership and public speaking.

Social media handles:

Rishabh Pandey | LinkedIn

@Databricks Tutorial: Introduction and Getting Started (youtube.com)

Thank you for sharing insights into your personal and professional journey, and for allowing us to learn from your greatness @Rishabh-Pandey 🌟

Join us in celebrating our Community members' journeys. Share your own experiences and insights to inspire others. Let's learn and grow together! 🚀

Featured Member Interview - July 2024 - G Samhitha Priyadarshini

Sujitha — Thu, 01 Aug 2024 10:25:47 GMT

Meet G Samhitha Priyadarshini, our featured member for this month! She has been our top contributor and possesses extensive knowledge in Databricks. She is also a Certified Lounge User Group owner.

Here are some of the questions we asked her during the interview, and these are her responses in her own words.

Name: G Samhitha Priyadarshini
Community nickname: @Priyag1 🌟
Pronouns: She/Her
Company: Cholamandalam Investment and Finance Company
Job Title: Senior Chief Manager – Data Analyst

Can you provide a brief overview of your career journey leading up to your current role?
Having completed my Master's in Thermal Engineering, I've developed a robust foundation in data analysis, extensive research skills, leadership, critical thinking, and communication. These academic pursuits not only shaped my technical acumen but also honed my ability to approach challenges with analytical rigor and innovation. I transitioned into the role of a data analyst, leveraging my academic insights to tackle diverse datasets and extract meaningful insights. My experience spans analysing various types of data, employing statistical methods to uncover patterns, and presenting findings to stakeholders effectively. My academic background has been instrumental in fostering a continuous learning mindset, enabling me to adapt quickly to new technologies and methodologies in data analysis. It has also instilled in me a strong sense of ethics and integrity, ensuring that my work aligns with professional standards and delivers reliable results. Currently, I am working as a Data Analyst in Enterprise Risk Management Team.Python, SQL, Power BI has been invaluable in my role, enabling me to transform data into visually compelling dashboards and reports that provide meaningful insights to stakeholders.

What do you enjoy most about your current job or role?
I apply my analytical prowess to assess and mitigate risks using data-driven approaches. I enjoy the process of translating complex data into clear, actionable strategies that enhance organizational resilience and decision-making.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?
Patient, Optimistic, Adaptable

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?
My parents and my friends Mrs. Manvitha, Mr.Rizwan and Mr. Kshitij Pachgare have been my unwavering support during challenging times, constantly motivating me to achieve professional growth and excellence. Their encouragement has been invaluable to me.

When and why did you first start using Databricks?
I got to know about Databricks in 2021 and used to follow few webinars conducted on the platform initially. My experience with Databricks Academy has been transformative. The platform has not only enhanced my technical skills but also deepened my understanding of data applications and business acumen. It has broadened my vision, equipping me with advanced techniques in data processing, analytics, and machine learning on the Databricks platform. Databricks has fundamentally changed how I approach data, allowing me to leverage its powerful capabilities to streamline workflows, optimize processes, and uncover hidden patterns that drive strategic initiatives.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
Databricks Academy courses and the learning features.

Is there a Databricks feature you wish existed or would like to see in future updates?
100% certification Vouchers like earlier, it encourages to participate in Databrick certification exams making the DB technology more reachable to organizations across the globe creating a greater pool of certified professionals.

When did you join the Databricks Community, and what motivated you to do so?
I joined the Databricks community in May 2022. My goal is to deepen my understanding of the subject matter while also helping others learn and grow.

What aspects of the Databricks Community do you find most valuable or enjoyable?
Databricks community is another wonderful knowledge sharing platform where one can interact and communicate professionally. It’s an interactive platform that gives diverse data challenges that one faces through their real-time experiences.

Outside of work, what is your favorite hobby or pastime?
I like to spend time with my family, friends. Sometimes I watch documentaries, read books or engage in gardening.

Where do you envision yourself professionally in the next three years?
In the next three years, I envision myself to work with Databricks.

Social Media Handles
Linkedin: https://www.linkedin.com/in/priyadarshini-g-015753185/

Samhitha's commitment to excellence and her role in breaking barriers for women in AI make her a role model for aspiring data professionals everywhere. 🌟

Join us in celebrating @Priyag1 achievements and her invaluable contributions to the Databricks Community. 🚀

Featured Member Interview - July 2024 - Yogita Chavan

Sujitha — Mon, 01 Jul 2024 16:37:03 GMT

Meet Yogita Chavan, a Pioneering Woman in AI.
Yogita is a trailblazer in the realm of artificial intelligence, proudly standing as our Community's very first woman featured member.

Here are some of the questions we asked her during the interview, and these are her responses in her own words.

Name: Yogita Chavan
Community nickname: @Yogic24
Pronouns: She/ Her
Company: Amdocs, Pune
Job Title: Data Engineer

Can you provide a brief overview of your career journey leading up to your current role?

I am Yogita Chavan, and my career journey has been a blend of technical education and hands-on experience. I hold a B.Tech in Electronics and Telecommunication, which laid the foundation for my technical skills. To further specialize, I pursued a CDAC certification in Big Data Analysis, which opened the door to the dynamic world of data.I began my professional career at Amdocs, where I have spent over three years as a Data Engineer.

In this role, I have developed and refined my expertise in data engineering, working on numerous projects that leverage data to drive impactful decisions. I am fortunate to be part of a team that is dedicated to the vision of using data-driven insights to enhance the quality of life, making decisions that lead to healthier and happier communities.

What do you enjoy most about your current job or role?
My favorite thing about my current role as a Data Engineer at Amdocs is the opportunity to work with cutting-edge technologies and large-scale data. I enjoy the challenge of solving complex data problems and the satisfaction of seeing how data-driven insights can lead to tangible improvements in business processes and decision-making. Additionally, being part of a collaborative and innovative team that shares a common goal of using data to create positive impacts makes the work environment truly inspiring and motivating.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?
My coworkers would use to describe me are quick problem solver, collaborative, and dependable. They appreciate my ability to efficiently tackle challenges, my willingness to work together to achieve our goals, and my reliability in delivering quality results.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?

Yes, I do have mentors in my professional life. My colleagues and my manager have been significant mentors to me. They have guided me through various challenges, provided invaluable insights, and shared their experiences to help me grow both professionally and personally. Their support and mentorship have been instrumental in shaping my career, and I am grateful for their continuous encouragement and guidance.

When and why did you first start using Databricks?

I started using Databricks in 2022 to explore new capabilities for our team's projects. Its scalability, unified platform for data tasks, and integration with tools like Apache Spark and MLflow made it a compelling choice for enhancing our data engineering and analytics capabilities.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?

I find two Databricks features particularly valuable in my work: the Autocomplete feature in Databricks Assistant and the Unity Catalog. The Autocomplete feature streamlines coding by suggesting commands and syntax, which boosts my productivity when working on complex data tasks. Meanwhile, the Unity Catalog enhances our data management capabilities by centralizing access to datasets and ensuring consistency across projects, which is crucial for maintaining data integrity and efficiency.

Is there a Databricks feature you wish existed or would like to see in future updates?

I'm eager to see Databricks evolve with enhanced native support for real-time data processing. Integrating more advanced streaming analytics capabilities directly within the platform would empower users to handle and derive insights from streaming data more seamlessly. This improvement could streamline our real-time data pipelines and enhance our ability to make timely, data-driven decisions.

When did you join the Databricks Community, and what motivated you to do so?

I began using Databricks in 2022 to explore its capabilities for personal projects and learning opportunities. It provided a valuable platform to familiarize myself with Databricks' features and gain hands-on experience in a collaborative environment.

What aspects of the Databricks Community do you find most valuable or enjoyable?

I find the most rewarding aspect of being part of the Databricks Community is the vibrant exchange of ideas and insights among like-minded data professionals. It's inspiring to collaborate with others who share a passion for data and analytics, learning from their diverse perspectives and discovering new approaches to using Databricks technology effectively. This community-driven learning environment not only enhances my skills but also encourages continuous innovation in tackling complex data challenges

Outside of work, what is your favorite hobby or pastime?

My favorite hobby is cooking. I find joy in experimenting with different cuisines and flavors. Besides that, I also enjoy playing games, which helps me unwind and have fun. Additionally, I have a passion for traveling and exploring new places, experiencing different cultures and cuisines firsthand

Where do you envision yourself professionally in the next three years?
In three years, I see myself furthering my expertise in data engineering and analytics, possibly taking on more leadership responsibilities. I aim to continue contributing to innovative projects that leverage data-driven insights to solve meaningful business challenges. Additionally, I envision expanding my skills in emerging technologies and furthering my professional development within a dynamic and collaborative work environment

Social Media Handles
Linkedin: https://www.linkedin.com/in/yogitachavan/

Yogita’s journey in AI exemplifies innovation and perseverance. Her contributions have significantly advanced our understanding of data engineering, making complex concepts accessible and inspiring countless practitioners and learners. Yogita's commitment to excellence and her role in breaking barriers for women in AI make her a role model for aspiring data professionals everywhere. 🌟

Join us in celebrating Yogita’s achievements and her invaluable contributions to the Databricks Community. 🚀

Featured Member Interview - June 2024 - Harun Raseed Basheer

Sujitha — Mon, 03 Jun 2024 11:56:48 GMT

Meet Harun Raseed Basheer, our Chennai user group owner, has a dynamic professional journey that began as an ETL developer and evolved into big data specialization with Databricks. He is a valued member of the Databricks Community, which he joined back in 2021 after being inspired by local meetups. With over six years of experience using Databricks, he continues to drive impactful decisions through data clarity and aims to transition into a techno-managerial role as a data architect in the coming years.

We presented him with a range of questions, and below, you will find his responses, expressed in his own words-

Name: Harun Raseed Basheer
Community Nickname: @Harun ⭐
Pronouns: He/Him/His
Company: Hitachi Solutions India Pvt Ltd
Job Title: Specialist - Data Engineer

Can you provide a brief overview of your career journey leading up to your current role?
I began my career as an ETL developer before transitioning into big data, specializing in Databricks as a platform. Currently, I leverage Databricks for primary big data processing in my role

What do you enjoy most about your current job or role?
I enjoy engaging with data and finding clarity within complexity, allowing me to uncover insights and drive impactful decisions.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?
If I had to describe myself in three words, they would be analytical, collaborative, and dependable. My coworkers often refer to me as a go-to person who is always eager to share knowledge and learn from others.

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?
I learn from everyone, regardless of their level of experience, valuing insights from both juniors and seniors. My all-time influencer has been my first Delivery Manager, who significantly shaped my professional growth.

When and why did you first start using Databricks?
I began using Databricks over six years ago for a complex transformation proof of concept, aiming to benchmark its performance against traditional ETL tools. The successful POC highlighted Databricks potential, leading to the migration of our entire data platform to big data in Databricks. Since then, I have mastered Databricks and continue to expand my knowledge.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
I particularly enjoy the Databricks Assistant Autocomplete feature and the Unity Catalog. These tools are indispensable in my work, enhancing efficiency and data management capabilities.

Is there a Databricks feature you wish existed or would like to see in future updates?
I would like to see a visual dashboard for all my scheduled jobs, allowing me to monitor all my notebooks and pipelines from a single page in a flow diagram format. This would greatly enhance oversight and management efficiency.

When did you join the Databricks Community, and what motivated you to do so?
I joined the Databricks Community on September 27, 2021. Prior to my online engagement, I actively participated in local meetups, which inspired me to extend my involvement to the online community. Networking with peers and sharing insights motivated me to join and contribute to the Databricks Community.

What aspects of the Databricks Community do you find most valuable or enjoyable?
I find the Databricks Community to be an invaluable resource, serving as a go-to destination for addressing any technical questions related to Databricks. The prompt and expert responses from individuals worldwide make problem-solving efficient and enjoyable.

Outside of work, what is your favorite hobby or pastime?
Outside of work, my favorite hobby is spending time with family and friends, as well as organizing and participating in tech meetups. If you happen to be in Chennai, you can often find me at various tech meetups every Saturday.

Where do you envision yourself professionally in the next three years?
In the next three years, I aspire to evolve into a techno-managerial role as a data architect. My goal is to spearhead the development of robust data pipelines within my organization while also contributing significantly to the tech Community as a thought leader and mentor.

Social Media Handles
Linkedin: https://www.linkedin.com/in/harunraseed/

Thank you for sharing your personal and professional journey with us. We appreciate the opportunity to learn from your experiences @Harun 😊🌟

Come, let's embark on a journey celebrating the experiences of our Community members. Dive into Harun's data-driven odyssey and uncover a wellspring of inspiration. Your next source of motivation awaits with just a scroll! 🚀

Featured Member Interview - May 2024 - Aman Sehgal

Sujitha — Mon, 06 May 2024 06:03:58 GMT

This month we have the pleasure of interviewing Aman Sehgal in our Community. He is a Data Engineer at Australian Red Cross Lifeblood. We are eager to delve into his experiences and insights in the realm of data engineering.

We presented him with a range of questions, and below, you will find his responses, expressed in his own words-

Name: Aman Sehgal 🌟
Community nickname: @AmanSehgal
Pronouns: He/Him
Company: Australian Red Cross Lifeblood
Job Title: Data Engineer

Can you provide a brief overview of your career journey leading up to your current role?

My journey in the realm of data engineering began with a strong research background at Monash University including a master’s degree and specialized training in distributed computing. It was then when I was introduced to big data and technologies around it. Moving from academics, I worked on major cloud migration projects and real time data analytics projects in retail, education and energy sector which accelerated my skills as a Data Engineer.

As of today, I’m working as Data Engineer at Australian Red Cross Lifeblood, using cutting edge technologies like Lakehouse and Generative AI. I’m fortunate to be part of transformative projects that streamline business processes to uplift Lifeblood’s capabilities in data space.

I’m grateful to be part of a team that shares the same vision—a world where data-driven decisions lead to healthier, happier lives.

What do you enjoy most about your current job or role?

As a data professional in the health sciences field, I carry a profound sense of responsibility and embrace the opportunity of working on life-saving projects.

In this dynamic field, data is our compass. We navigate through datasets and work toward improving the quality of our donor experience, collection center performance, manufacturing processes and keeping business ahead by enabling them in making data driven decisions.

I’m fortunate to collaborate with an exceptional team and together we embrace latest technologies – cloud solutions, real time processing, AI and ML. When you’re surrounded by passionate minds, every challenge becomes an opportunity.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?

That’s a tough one. Maybe challenge-seeker, researcher and analytical

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?

In my professional career, I’ve had an opportunity to work with highly experienced and great colleagues who helped me at every level. Also, content from lots of researchers and tech bloggers have helped me in developing my skillset.

To name, I would like to mention two researchers because of whom I’m in working in data industry:

My professor at Monash University, Dr. Asad Khan who introduced me to distributed computing in 2017. While working on a thesis I realised its potential and it shaped my career from there on.
Matei Zaharia – I started my thesis with his research paper on Spark. His work has played a pivotal role in data industry and has transformed the way we work with data.

When and why did you first start using Databricks?
I started using Databricks in 2019 at work for a cloud migration project. The platform has evolved a lot since then, and I find something new to learn every day.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?
Delta live tables, Unity Catalog, Serverless SQL

Is there a Databricks feature you wish existed or would like to see in future updates?

Serverless DLT
UI for unity catalog to monitor and manage access control
AI suggestions for code optimisation

When did you join the Databricks Community, and what motivated you to do so?

I joined the community over 18 months ago. Helping someone using my experience gives me a great sense of achievement and satisfaction. Probably this was the primary reason why I joined the community as I saw that with my experience I can help community members and save their time in getting a solution to a problem that is just killing their time.

What aspects of the Databricks Community do you find most valuable or enjoyable?
With over 100,000 members, there’s so much experience and knowledge sharing in the community, that you’re bound to learn or get a response to your questions. Members go out of their way to resolve issues and assist with great dedication. The level of support makes bricksters feel that they’re not alone, someone in the group will lend a helping hand.

Outside of work, what is your favorite hobby or pastime?
Cooking, driving and plane spotting.
I’m also an active blood donor and I ensure that I keep continuing to do so.

Where do you envision yourself professionally in the next three years?
With GenAI on the rise, it’s difficult to predict next 3 years. But maybe I’ll be working as a coach with businesses to develop data and AI solutions. Or maybe I would have become a pilot, flying UAVs.

Social Media Handles
Linkedin: https://www.linkedin.com/in/aman-sehgal-403a098a/

Thank you for sharing your personal and professional journey with us. We appreciate the opportunity to learn from your experiences @AmanSehgal 😊🌟

Come, let's embark on a journey celebrating the experiences of our Community members. Explore the depths of Aman's data-driven odyssey and uncover a wellspring of inspiration. Your next source of motivation awaits with just a scroll! 🚀

Featured Member Interview - April 2024 - Ranjit Kumar Kanamarlapudi

Sujitha — Mon, 01 Apr 2024 05:39:55 GMT

Before we jump into the interview, allow us to introduce Ranjit Kumar Kanamarlapudi, a Senior Data Warehouse Architect at Tiger Analytics, known for his profound passion for data.

We presented him with a range of questions, and below, you will find his responses, expressed in his own words-

Name: Ranjit Kumar Kanamarlapudi
Community nickname: @KVNARK 🌟
Pronouns: He/Him
Company: Tiger Analytics, Chennai, India
Job Title: Senior Datawarehouse Architect

Can you provide a brief overview of your career journey leading up to your current role?

As a Senior Data Warehouse Architect at Tiger Analytics, I bring extensive expertise in ETL, Big Data technologies, Pyspark, Databricks, and Cloud data warehousing (including Azure ADF and Synapse analytics). My certifications as an Azure Data Engineer Associate and Databricks Data Engineer Associate validate my proficiency. I specialize in designing robust data warehouse architectures, meticulously considering scalability, performance, security, and cost. My impactful contributions have shaped data warehousing platforms and optimized data source selection. My ability to tackle intricate challenges and consistently deliver results sets me apart.

What do you enjoy most about your current job or role?

As a Senior Data Warehouse Architect at Tiger Analytics, I find immense satisfaction in designing robust data warehouse architectures. The blend of creativity, problem-solving, and the impact of my work on data warehousing platforms truly excites me.

If you had to describe yourself using three words, what would they be? How do you think your coworkers would describe you?

Adaptable, Analytical and Collaborative

Have you had any mentors or significant influences in your professional life? If so, could you tell us about them?

In my professional journey within the data engineering field, I have been fortunate to have mentors who have significantly influenced my growth.

5 individuals stand out particular in my entire IT career.

Riaz Abdul Samadh: Riaz provided me with the opportunity to work on my first cloud project. He was the person who gave me an oppurtunity to step into the world of cloud computing and prove myself. Wherever my path leads, I’ll carry his wisdom, his compassion, and his unwavering belief in my journey.

Balaje MS Viswanathan: Balaje has been a guiding light throughout my career. Balaje doesn’t merely manage deliveries; he nurtures growth. His unwavering belief in my potential has fueled my ambition. When I doubted my abilities, he reminded me that every challenge is an opportunity to learn and excel.

When and why did you first start using Databricks?

I began my journey with Databricks approximately an year ago. The decision to embrace Databricks was driven by its unified analytics platform, which offered a seamless environment for building, deploying, and managing data at scale.

Are there any Databricks features that you particularly enjoy or find indispensable in your work?

Databricks note books and AI-Generated Table Comments in Catalog Explorer

Is there a Databricks feature you wish existed or would like to see in future updates?

There’s one feature that I believe would significantly enhance the user experience - Resource Monitoring and Usage Alerts on DBU Consumption at Cluster Level

When did you join the Databricks Community, and what motivated you to do so?

I embarked on my journey with the Databricks Community approximately 18 months back. The reason why I joined is exchange Knowledge, to participate actively in interactive forums, networking oppurtunituies etc.

What aspects of the Databricks Community do you find most valuable or enjoyable?

The points they provided in databricks community as and when you provide an answers to the questions asked in databricks commuity previously encouraged me a lot to complete the certification exam and also able to redeem the points in the form of databricks goodies which are very much useful to me.

Outside of work, what is your favorite hobby or pastime?

Playing Table Tennis and watching suspense and thriller movies.

Where do you envision yourself professionally in the next three years?

I should be in a position to provide solution architecture in the field of data engineering. what ever may the problem , I should be able to provide solution for the same. I would like to reach to that level 3 years doiwn the line.

Social Media Handles

Linkedin: https://www.linkedin.com/in/ranjit-kumar-kanamarlapudi

Thank you for sharing your personal and professional journey with us. We appreciate the opportunity to learn from your experiences @KVNARK 😊🌟

Join us in celebrating our Community members' journeys. Dive deeper into Ranjit's world of data and discovery. Your next dose of inspiration is just a scroll away! 🚀