- 5940 Views
- 5 replies
- 0 kudos
Unity cataog
Disaster recovery is possible in Unity catalog now?Means, for data level, we have enabled with geo redundancy, what about the objects, permissions, an other components in Unity catalog ? Can we restore the unity catalog metadata in another region ?
- 5940 Views
- 5 replies
- 0 kudos
- 0 kudos
Official product release in development will be available as PrPr in a few months.
- 0 kudos
- 334 Views
- 0 replies
- 1 kudos
Managing Databricks CLI Versions in Your DAB Projects
If you are going with DABS into a production environment, a CLI version is considered best practice. Of course, you need to remember to bump it up from time to time. Learn more: - https://databrickster.medium.com/managing-databricks-cli-versions-i...
- 334 Views
- 0 replies
- 1 kudos
- 625 Views
- 0 replies
- 1 kudos
Distributed ML on Databricks Serverless
You can now run distributed ML (Spark MLlib in Python, Optuna tuning, MLflow Spark, Joblib Spark) on serverless notebooks/jobs and on standard clusters, not just dedicated ML clusters.It reuses the same Unity Catalog + Lakeguard stack you already use...
- 625 Views
- 0 replies
- 1 kudos
- 3335 Views
- 0 replies
- 1 kudos
Why Your Delta Lake MERGE Takes Forever (And How to Fix It)
Last month, our nightly CDC pipeline started timing out. What used to complete in 20 minutes was now crawling past the 4-hour mark—and failing. The culprit? A MERGE statement against a 2.3TB Delta table with 800 million rows that had grown steadily o...
- 3335 Views
- 0 replies
- 1 kudos
- 799 Views
- 3 replies
- 0 kudos
Real-Time SQL Server to Databricks Pipeline Using Debezium, Kafka, and Delta Lake
Check this medium article https://medium.com/@bijumathewt/real-time-sql-server-to-databricks-pipeline-using-debezium-kafka-and-delta-lake-26c3e191ce51?postPublishedType=initial
- 799 Views
- 3 replies
- 0 kudos
- 0 kudos
would you not be able to use Lakeflow Managed connector for SQL Server in this case?
- 0 kudos
- 561 Views
- 0 replies
- 2 kudos
🚀 Automating Databricks Unity Catalog Access with AI Agents
Tired of complex governance workflows? We’ve successfully combined the power of multi-agent AI with state-of-the-art orchestration tools to automate Databricks Unity Catalog (UC) access management!This isn’t just a basic script — it’s an intelligent,...
- 561 Views
- 0 replies
- 2 kudos
- 234 Views
- 0 replies
- 0 kudos
Real-World LangGraph + CrewAI Application:Intelligent Databricks Alert System with AI Prioritization
https://medium.com/@bijumathewt/real-world-langgraph-crewai-application-intelligent-databricks-alert-system-with-ai-7ba36e23f7a2You will love above article
- 234 Views
- 0 replies
- 0 kudos
- 243 Views
- 0 replies
- 0 kudos
Real-World LangGraph + CrewAI Application: Intelligent Databricks Alert System with AI Prioritizatio
You will love this article. Watch it. https://medium.com/@bijumathewt/real-world-langgraph-crewai-application-intelligent-databricks-alert-system-with-ai-7ba36e23f7a2
- 243 Views
- 0 replies
- 0 kudos
- 2682 Views
- 0 replies
- 1 kudos
Delta Lake 4.0 in the Real World
Delta Lake 4.0 is the next major open-source release aligned with Spark 4.x, adding first-class Variant for semi-structured data, safer Type Widening, improved DROP FEATURE, better transaction log handling, and a new multi-engine story via Delta Kern...
- 2682 Views
- 0 replies
- 1 kudos
- 643 Views
- 1 replies
- 3 kudos
PDFs to Production
Databricks just solved a huge problem - unlocking the value from unstructured data. One of the biggest challenges enterprises face when scaling agents is access to unstructured data. Nearly 80% of enterprise knowledge is trapped in PDFs, reports, and...
- 643 Views
- 1 replies
- 3 kudos
- 3 kudos
Thanks for sharing, @venkat-raghavan! ai_parse_document turns documents into governed, queryable assets, it's definitely the puzzle piece all needed.
- 3 kudos
- 811 Views
- 0 replies
- 2 kudos
Databricks Managed MCP Servers
This is super amazing and super powerful -https://docs.databricks.com/aws/en/generative-ai/mcp/managed-mcpEssentially we you can use Databricks managed MCP servers to seamlessly integrate Databricks features into any AI Agent. That's the multiplier ...
- 811 Views
- 0 replies
- 2 kudos
- 865 Views
- 1 replies
- 5 kudos
Python Data Source API
If you’ve ever hacked together a one-off script to pull data from some random API into Spark, you’re exactly who the new Python Data Source API is for. Databricks has made this API generally available on Apache Spark™ 4.0 with Databricks Runtime 1...
- 865 Views
- 1 replies
- 5 kudos
- 5 kudos
I have seen multiple glue jobs pulling data from such systems. This is certainly a solution to simplify and bring governance to it. will look forward to implement it.#Apache-4
- 5 kudos
- 606 Views
- 0 replies
- 1 kudos
Databricks Serverless Compute: Zero Infrastructure Management
You spend hours sizing clusters, tuning autoscaling configurations, and optimizing instance types.Clusters sit idle burning money between jobs or take minutes to start when you need them immediately.Managing compute infrastructure becomes a full-time...
- 606 Views
- 0 replies
- 1 kudos
- 874 Views
- 1 replies
- 3 kudos
Databricks + Power BI
Last night I delivered my final session on Databricks + Power BI integration and it felt like the right moment to close this chapter on a high note. Because it was the last time I was presenting this topic, I rebuilt the flow completely. Instead of ...
- 874 Views
- 1 replies
- 3 kudos
- 3 kudos
Well done Bianca. Look forward to Fabric session.
- 3 kudos
- 1573 Views
- 1 replies
- 8 kudos
Recap: Data & AI World Tour - Chicago, Nov 19, 2025
Yesterday in Chicago, I attended one of the final stops of the Databricks DAIWT (Data & AI World Tour). This tour brings the excitement and passion of our annual Data + AI Summit to over a dozen cities worldwide, in a condensed format. Packed into ...
- 1573 Views
- 1 replies
- 8 kudos
- 8 kudos
These are great events. I had the opportunity to attend the Toronto event.
- 8 kudos
| User | Count |
|---|---|
| 85 | |
| 71 | |
| 47 | |
| 44 | |
| 42 |
