We are evolving our weekly updates! ๐
Starting this week, weโre combining our Weekly Delta and Weekly Spark series into one comprehensive wrap-up โ Community Pulse โ your single source for everything buzzing in the Databricks Community.
Why the change?
Because weโre expanding our weekly highlights to include even more content โ from top discussions and technical blogs to meetups, announcements, and standout contributors. Expect more insights, more activity, and more reasons to stay connected! โจ
๐ฅ Highlights from the last week
Hereโs what kept the community active and inspired over the past week ๐
๐ก Top Discussions & Solutions
- How to Retrieve DBU Count per Compute Type for Accurate Cost Calculation? โ Practical guidance on tracking DBU usage efficiently.
- Networking Challenges with Databricks Serverless Compute โ Explored control plane connectivity and on-prem access challenges.
- DLT Pipeline Fails with โCannot Infer Schemaโ โ Shared lessons from common DLT limitations.
- Replay Stream to Migrate to Liquid Cluster โ Practical steps for optimizing migration strategies.
- Slow PySpark Operations After Long DAG โ Continued collaboration on tuning PySpark performance.
- Disable SQL Warehouse During Weekends โ Creative workaround and feature request recommendation.
- Row_Number() in DLT Pipelines โ Discussed current constraints and implementation tips.
- How to Reduce Data Loss for Delta Lake During Failover? โ Valuable resilience strategies shared.
๐ง Community Blogs
- Databricks Assistant Data Science Agent: Autonomous Analytics for Petroleum Engineers
- Azure Databricks โ Serverless Private Connectivity to Customerโs Resources (Part 1)
- How to Deploy Agent-to-Agent (A2A) Protocol on Databricks Apps
- Hadoop Walked So Databricks Could Run โ A nostalgic look at how far weโve come!
- Databricks Free Edition Performance Test โ Hands-on insights from the Free Edition experience
๐ Community MVPs
Shoutout to @szymon_dybczak, @nayan_wylde, @ManojkMohan, @BS_THE_ANALYST, and @Hubert-Dudek for their consistent contributions and for helping others troubleshoot with precision and patience!
๐ฌ Stay tuned โ our next Community Pulse will feature not just weekly highlights but also top events, challenges, and featured members. Letโs keep the energy high and the learning flowing! ๐
