We are evolving our weekly updates! 🎉
Starting this week, we’re combining our Weekly Delta and Weekly Spark series into one comprehensive wrap-up — Community Pulse — your single source for everything buzzing in the Databricks Community.
Why the change?
Because we’re expanding our weekly highlights to include even more content — from top discussions and technical blogs to meetups, announcements, and standout contributors. Expect more insights, more activity, and more reasons to stay connected! ✨
🔥 Highlights from the last week
Here’s what kept the community active and inspired over the past week 👇
💡 Top Discussions & Solutions
- How to Retrieve DBU Count per Compute Type for Accurate Cost Calculation? — Practical guidance on tracking DBU usage efficiently.
- Networking Challenges with Databricks Serverless Compute — Explored control plane connectivity and on-prem access challenges.
- DLT Pipeline Fails with “Cannot Infer Schema” — Shared lessons from common DLT limitations.
- Replay Stream to Migrate to Liquid Cluster — Practical steps for optimizing migration strategies.
- Slow PySpark Operations After Long DAG — Continued collaboration on tuning PySpark performance.
- Disable SQL Warehouse During Weekends — Creative workaround and feature request recommendation.
- Row_Number() in DLT Pipelines — Discussed current constraints and implementation tips.
- How to Reduce Data Loss for Delta Lake During Failover? — Valuable resilience strategies shared.
🧠 Community Blogs
- Databricks Assistant Data Science Agent: Autonomous Analytics for Petroleum Engineers
- Azure Databricks — Serverless Private Connectivity to Customer’s Resources (Part 1)
- How to Deploy Agent-to-Agent (A2A) Protocol on Databricks Apps
- Hadoop Walked So Databricks Could Run — A nostalgic look at how far we’ve come!
- Databricks Free Edition Performance Test — Hands-on insights from the Free Edition experience
🙌 Community MVPs
Shoutout to @szymon_dybczak, @nayan_wylde, @ManojkMohan, @BS_THE_ANALYST, and @Hubert-Dudek for their consistent contributions and for helping others troubleshoot with precision and patience!
💬 Stay tuned — our next Community Pulse will feature not just weekly highlights but also top events, challenges, and featured members. Let’s keep the energy high and the learning flowing! 🚀