Introducing Community Pulse — Your Weekly Databricks Roundup!

Sujitha
Databricks Employee
Databricks Employee

We are evolving our weekly updates! 🎉
Starting this week, we’re combining our Weekly Delta and Weekly Spark series into one comprehensive wrap-up — Community Pulse — your single source for everything buzzing in the Databricks Community.

Why the change?
Because we’re expanding our weekly highlights to include even more content — from top discussions and technical blogs to meetups, announcements, and standout contributors. Expect more insights, more activity, and more reasons to stay connected!

🔥 Highlights from the last week

Here’s what kept the community active and inspired over the past week 👇

💡 Top Discussions & Solutions

  • How to Retrieve DBU Count per Compute Type for Accurate Cost Calculation? — Practical guidance on tracking DBU usage efficiently.
  • Networking Challenges with Databricks Serverless Compute — Explored control plane connectivity and on-prem access challenges.
  • DLT Pipeline Fails with “Cannot Infer Schema” — Shared lessons from common DLT limitations.
  • Replay Stream to Migrate to Liquid Cluster — Practical steps for optimizing migration strategies.
  • Slow PySpark Operations After Long DAG — Continued collaboration on tuning PySpark performance.
  • Disable SQL Warehouse During Weekends — Creative workaround and feature request recommendation.
  • Row_Number() in DLT Pipelines — Discussed current constraints and implementation tips.
  • How to Reduce Data Loss for Delta Lake During Failover? — Valuable resilience strategies shared.

🧠 Community Blogs

  • Databricks Assistant Data Science Agent: Autonomous Analytics for Petroleum Engineers
  • Azure Databricks — Serverless Private Connectivity to Customer’s Resources (Part 1)
  • How to Deploy Agent-to-Agent (A2A) Protocol on Databricks Apps
  • Hadoop Walked So Databricks Could Run — A nostalgic look at how far we’ve come!
  • Databricks Free Edition Performance Test — Hands-on insights from the Free Edition experience

🙌 Community MVPs
Shoutout to @szymon_dybczak, @nayan_wylde, @ManojkMohan, @BS_THE_ANALYST, and @Hubert-Dudek for their consistent contributions and for helping others troubleshoot with precision and patience!


💬 Stay tuned — our next Community Pulse will feature not just weekly highlights but also top events, challenges, and featured members. Let’s keep the energy high and the learning flowing! 🚀