Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
Cybersecurity in multicloud, multiregion environments can be complicated by fragmented security controls, data dispersion and compliance requirements. The IOC Matching and Multicloud Query Federation Solution Accelerator shows how a lakehouse platfor...
A claim document may contain a policy number, loss date, estimated amount, and a description spread across paragraphs and form fields. Extracting those values is useful but we also need to know where they came from and whether they are suitable for d...
I put together a practical guide to Delta Lake table layouts, with SQL examples in Databricks:When to consider partitioning or Liquid Clustering.How OPTIMIZE works with partitions, ZORDER, and clustering.How to compare bytes scanned, query latency, a...
Two colleagues ask the same chatbot the same question. Should they get the same answer, ordifferent ones because they are allowed to see different things? Every organisation that puts an AIassistant on top of its own documents runs into this sooner o...
You cluster a table on a column, run the query, and nothing improves. The layout command completed successfully. The column is definitely in the filter. The file count in the query profile has not moved.Before assuming the clustering did not work, ch...
Cybersecurity investigations often require sifting through large volumes of log and telemetry data to uncover the patterns and relationships behind threat activity. The Incident Investigation Using Graphistry Solution Accelerator shows how to query i...
Public sector agencies need well-informed decisions to support the livelihood and security of citizens. The Entity Resolution for Public Sector Solution Accelerator shows how entity resolution can connect disparate data sources, reveal relationships ...
Hi All, Many teams using Databricks today are referring to their work as “full stack development,” which can be a bit confusing at first. In the Databricks context, this doesn't mean a new framework — it simply means handling everything from raw data...
In Databricks, full stack development means building the complete solution around the data platform—from data ingestion and processing with Spark/Delta Lake to APIs, AI/ML models, dashboards, and user-facing applications. It connects Databricks’ data...
Hi Everyone,Recently, I led an end-to-end Lakehouse project for a client that was struggling with manual, error-prone reporting and disconnected data silos. Their core business problem was simple yet critical: the business could not trust its own num...
I just earned my Databricks Certified Generative AI Engineer Associate Certification, and in this post, I’m sharing the key tips, resources, and personal insights that helped me succeed. My certiticate from DatabricksNavigation:PreludeAbout the certR...
Congratulations on your achievement! Your tips are really helpful. I also found this resource useful during my preparation: https://ln.run/-c8lD. It worked well alongside the official learning materials.
An open dbt-databricks feature request, #1271, asks for native RELY support on primary keys and suggests that rely: true "implicitly create the not_null and unique constraints" as "a safeguard against incorrect query results". Databricks does not enf...
Databricks Training & Certifications
Learn Databricks AI Agents
Systems that reason, call tools, and take action - built on the Databricks Platform.
Agentic AI Mosaic AI & Agent Bricks 易 Persistent memory
AI agents...
Just wrapped Partner Tech Summit: four days across Genie & Agents, the Lakehouse Platform, Lakebase and Governance. The big lesson? AI doesn’t have an intelligence problem. It has a context problem. Well-governed, well-organised data is what turns it...
I registered a mock MCP server in Unity Catalog, exposed only its read tool, attached a deny policy, and then called the delete tool anyway. What decided the outcome was access to the underlying connection, and it came from grants on the schema, not ...
Every serious data platform grows a dead-letter table, and it always becomes a graveyard. Here is how we turned one into a self-healing queue — without letting a language model anywhere near the warehouse.Every data platform that takes quality seriou...
Thanks for sharing, @KeerthiItigimat, what a great breakdown. How do you handle rules changing while rows are waiting in quarantine? Does remediation keep the original checks, use the latest approved rules, or run both?