Databricks Community

Databricks Metric Views

What is a Metric View? (Think of it as a virtual report definition)Metric Views are a first-class object in Databricks Unity Catalog that allow you to define reusable, governed business metrics on top of your existing tables and views.Think of them a...

How to enable a custom URL in Azure Databricks?

Azure Databricks now allows organisations to configure a custom URL at the account level, providing a unified and branded access point for all users.Instead of navigating multiple workspace-specific URLs, users can log in once using a single custom U...

Databricks AI/BI Genie Space: Unlocking Generative AI on Delta Tables for Smarter Analytics

Sharing the latest update on Databricks Genie.The written article is in 3 versions to make it easy to follow the journey:Version 1 covers the initial releaseVersion 2 includes the major improvementsVersion 3 has the latest updates till 2026     Agent...

Databricks SQL Runtime 18.0 and above: ATOMIC Compound Statement

The ATOMIC Compound Statement in Databricks SQL is a block of statements that executes as a single, all-or-nothing transaction. If any statement inside the block fails, the entire block is rolled back. Read Complete Article here:Databricks SQL Runtim...

Practical observations on working with Databricks Genie Code

I’ve been exploring Databricks Genie Code and wanted to share a few practical observations from early usage.What stands out to me is that Genie Code feels less like a traditional coding assistant and more like an agentic workflow assistant. It does n...

I looked into Genie Code costs in Databricks — it’s cheap until it isn’t

I’ve been testing Genie Code in Databricks and wanted to understand not just the UX, but the actual cost behavior.My impression so far:for simple code edits / code assistance, it looks almost free,but if Genie Code starts doing things that involve re...

Genie Code: Background Agents That Keep Your Data Workloads Healthy

Modern data platforms require constant monitoring and maintenance. From pipeline failures to schema changes, data engineers often spend a large portion of their time reacting to operational issues rather than building new solutions. This is where bac...

Migration from Azure Data Factory(ADF) to Databricks Lakeflow Jobs

Many teams think migrating from Azure Data Factory to Databricks Lakeflow Jobs is just a pipeline rewrite. It’s not.It’s about:* Simplifying over-engineered architectures* Reducing orchestration and monitoring overhead* Aligning data engineering with...

Setting 1-Minute SQL Warehouse Auto-termination via API in Databricks

Hi everyone, I wanted to share a quick technical tip for those looking to optimize their SQL Warehouse configurations, especially when dealing with intermittent ad hoc queries or AI BI Dashboards. The Challenge: When setting up a SQL Warehouse, the D...

Stop Guessing Your Data’s Trust Level: Use Databricks System Tags

Recently, Databricks introduced System Tags, allowing you to explicitly label objects as Certified, Deprecated or None.Certification status system tagThe certified status system tag allows users to label objects, such as catalogs, schemas, tables, da...

API Monitoring of Scheduled Jobs: Lakeflow in Databricks

At Databricks, more and more teams are starting to use Lakeflow (Jobs & Pipelines), and some companies use it primarily for orchestrating scripts in Databricks. It's a powerful tool for building dependencies, but as the number of jobs grows, problems...

API monitoring of All-purpose clusters

A lot of Databricks spend isn’t “compute” at all — it’s paid idle time on all‑purpose clusters while they sit around waiting for Auto Termination. Databricks UI is great at showing starting/running/terminating, but it often hides the key operational ...

Time Zones in Databricks

You might not have encountered time zones in Databricks yet. I recommend reading this article (Link to the full text) it will save you from unnecessary problems. There's also an infographic below that you might find useful.

How do you find out What's New in Databricks?

OCR Made Simple with Databricks AI Functions

Databricks MVP Conner Schiissler explores the new ai_parse_document() function, which replaces complex OCR integrations with a simple SQL command to extract structured markdown from unstructured files. Read here.