- 3361 Views
- 2 replies
- 1 kudos
Databricks Vector Search Integration: Powering Claude Desktop with MCP
https://medium.com/@bijumathewt/databricks-vector-search-integration-powering-claude-desktop-with-mcp-838c591b50b5
- 3361 Views
- 2 replies
- 1 kudos
- 1 kudos
Good Question Edonaire. There 2 options here. Continuous and Triggered. If continuous, it will take care of incrimental load automatically, but costly.Triggered can be filed by setting up job with a task to run the "Refresh" code.
- 1 kudos
- 2393 Views
- 0 replies
- 1 kudos
From Data to Deck — Auto-Generate PowerPoint from Databricks
Creating PowerPoint decks from data is usually manual and repetitive:Export charts → take screenshots → format slides → repeat.Not anymore.You can now generate a complete PowerPoint directly from a Databricks table — in one notebook run. What this do...
- 2393 Views
- 0 replies
- 1 kudos
- 2959 Views
- 2 replies
- 8 kudos
Congratulations to Matei Zaharia - CTO Databricks on the ACM Prize in Computing
When I saw the news that Matei Zaharia received the 2025 ACM Prize in Computing, I felt genuinely happy. It was not just another award announcement. It felt like a proud moment for the whole data engineering community. His work has helped shape the w...
- 2959 Views
- 2 replies
- 8 kudos
- 8 kudos
@Brahmareddy, what a beautiful tribute! It’s so inspiring to hear how that meeting at the Summit stayed with you.We’re so lucky to have contributors like you who recognize the heart behind the tech. Cheers to Matei and the whole Databricks family!
- 8 kudos
- 1021 Views
- 1 replies
- 2 kudos
Austin’s Practical Data + AI Meetup
Austin data community, this one looks worth attending. Databricks DevConnect Austin is happening on Tuesday, April 14, 2026, from 5:00 PM to 9:00 PM at Qubika Office in Austin. It is a technical meetup built for data and AI practitioners who want rea...
- 1021 Views
- 1 replies
- 2 kudos
- 2 kudos
Great opportunity to connect with amazing and like minded minds.Would love to see more such events in India as well, specially in Lucknow, Noida, Bhopal -- Events Team
- 2 kudos
- 662 Views
- 0 replies
- 1 kudos
Solution Proposal (Cost-Optimized Architecture)
Core IdeaDon’t let “1 pipeline = 1 always-on cluster” become your cost trap.Instead, design for controlled parallelism + shared compute + smart grouping. A. Pipeline Sharding Strategy (Not Blind Splitting)Instead of randomly splitting 6,700 tables i...
- 662 Views
- 0 replies
- 1 kudos
- 4333 Views
- 1 replies
- 6 kudos
MCP Servers on Databricks
MCP Servers on DatabricksGenerative AI is evolving rapidly, and one of the most exciting developments is standardizing how models interact with external systems. Let me walk you through how we got here and why the Model Context Protocol (MCP)—especia...
- 4333 Views
- 1 replies
- 6 kudos
- 6 kudos
Insightful, detailed and incisive guide @VinayKumarB. Keep posting!
- 6 kudos
- 825 Views
- 2 replies
- 3 kudos
Notifications for scheduled refreshes - now in Beta
If you’ve ever worked with scheduled refreshes for Materialized Views or Streaming Tables, you probably know this pain. If your DDL-scheduled MV or ST refresh failed, nothing happened. No email, no alert, no indication that your data was stale (until...
- 825 Views
- 2 replies
- 3 kudos
- 3 kudos
Welcome back, @szymon_dybczak! That silent failure pain was real. These alerts are a massive win for everyone’s sanity. Thanks for the heads-up!
- 3 kudos
- 1040 Views
- 0 replies
- 2 kudos
Databricks Clean Rooms - Eliminate Data Exposure & Maximize Insights
Databricks Clean Rooms are secure & governed collaboration environments that enable various organizations to run joint analytics without exchanging raw data eliminating sensitive data exposure. Its built-on Delta Sharing, Serverless and Unity Catalog...
- 1040 Views
- 0 replies
- 2 kudos
- 3690 Views
- 1 replies
- 1 kudos
When Did the Data Go Wrong? Using Delta Lake Time Travel for Investigation in Databricks
I. IntroductionData pipelines are the lifeblood of modern data-driven organizations. However, even the most robust pipelines can experience unexpected issues: data corruption, erroneous updates, or sudden data drops. When these problems occur, quickl...
- 3690 Views
- 1 replies
- 1 kudos
- 1 kudos
Great thought to use delta time travel to determine when data drift starts!But this only works as long as retention policies allow it. With vacuum and stricter runtime enforcement in newer dbx versions, older snapshots may not be there when you need ...
- 1 kudos
- 944 Views
- 0 replies
- 1 kudos
Intelligence Studio -- Open-Source AI-Powered API Explorer for Databricks
Hi everyone,I built Intelligence Studio, an open-source workbench that lets you browse, test, analyse, and integrate with 640+ Databricks REST APIs -- all from one interface. No more juggling docs, curl commands, Postman collections, and multiple bro...
- 944 Views
- 0 replies
- 1 kudos
- 1271 Views
- 0 replies
- 2 kudos
Databricks Multi-Table Transactions - Part 2
In Part 1, we covered why multi-table transactions matter. Now let's build one. We'll create the tables from the claim wrap-up scenario, load sample P&C insurance data, and walk through what happens when the wrap-up succeeds, when it fails, and when...
- 1271 Views
- 0 replies
- 2 kudos
- 2808 Views
- 1 replies
- 5 kudos
Solving Multi-Dimension Analytics in Databricks Dashboards with Views and Metric Views
If you've ever built a dashboard where you needed to track the same data across two different date dimensions, you know the frustration. You get the first chart working. You add the second. Then you realise cross-filtering just stopped working. I re...
- 2808 Views
- 1 replies
- 5 kudos
- 5 kudos
Thanks for sharing great example with detailed explanation.
- 5 kudos
- 3881 Views
- 0 replies
- 1 kudos
How to actually get job_id and run_id in a Databricks Python wheel task (Avoid Hallucinations)
We needed job_id and run_id in a custom metrics Delta table so we could join to `system.lakeflow.job_run_timeline`. Tried four approaches before finding the one that works on serverless compute.What doesn't workspark.conf.get("spark.databricks.job.id...
- 3881 Views
- 0 replies
- 1 kudos
- 2078 Views
- 3 replies
- 1 kudos
PostgreSQL to Databricks made simpler with Lakeflow Connect(Public Preview)
PostgreSQL to Databricks made simpler with Lakeflow Connect (Public Preview).Databricks has introduced a PostgreSQL connector in Lakeflow Connect (Public Preview), enabling ingestion of PostgreSQL data into the Lakehouse using logical replication.Ins...
- 2078 Views
- 3 replies
- 1 kudos
- 1 kudos
You can enable or disable previews using account console for account level previews and workspace for workspace level previews.More details here
- 1 kudos
- 1249 Views
- 0 replies
- 2 kudos
Turning Lakehouse into Brainhouse via Knowledge Graphs
Organizations solved the challenge of collecting, cleaning & governing structured data at scale via Delta Lake and Unity Catalog in Lakehouse. You have world class lineage, permissions, RBAC, ABAC and schemas as the nervous system. The nervous system...
- 1249 Views
- 0 replies
- 2 kudos
| User | Count |
|---|---|
| 85 | |
| 76 | |
| 73 | |
| 60 | |
| 43 |
