This page brings together externally published articles written by our MVPs. Discover expert perspectives, real-world guidance, and community contributions from leaders across the ecosystem.
19 is already here, but 18 is now LTS. In a new naming convention, LTS doesn’t have a minor version. New features, behavior changes, and fixes are now added incrementally to the same major Runtime version till it becomes LTS. In fact, that approach s...
Not yet an automatic update, but at least we can check whether our CLI version is up to date. #databricks
My blog post with news: https://databrickster.medium.com/databricks-news-dabs-indexes-ltap-genie-last-update-25-july-ffac8533774f
Genie Spaces (now renamed to Genie Agents) are available now in DABs as … Genie Spaces. First, you need to run bundle generate to export your existing development Genie into a bundle. #databricks
My blog post with news: https://databrickster.medium.c...
We can use Genie now, even in the CLI, with a simple ask command. #databricks
My blog post with news: https://databrickster.medium.com/databricks-news-dabs-indexes-ltap-genie-last-update-25-july-ffac8533774f
If we set the REPLICA option in Postgres, we can then set CDF sync to Unity Catalog in the branch overview. #databricks
more news and video https://medium.com/databrickscommunity/databricks-news-rt-lakehouse-reyden-lakebase-ttl-8416bdccf627
One of the biggest challenges in modern data work isn’t just collecting information — it’s trusting it. Data moves through so many pipelines, transformations, and dashboards that by the time it reaches a business user, the question often becomes: whe...
I’ve been testing Genie Code in Databricks and wanted to understand not just the UX, but the actual cost behavior.My impression so far:for simple code edits / code assistance, it looks almost free,but if Genie Code starts doing things that involve re...
Great writeup - I'm also facing the same problem with Genie Code.1. This billing attribution gap isn't specific to Genie Code, it shows up anywhere an agent/orchestration layer spins up ad-hoc compute (serverless one) on your behalf. Eventhough you c...
As data engineers, we spend a significant amount of time writing SQL queries to ingest, transform, and analyse data. However, writing a query that returns the correct results is only part of the equation. Equally important is understanding how Spark ...
Azure Databricks now allows organisations to configure a custom URL at the account level, providing a unified and branded access point for all users.Instead of navigating multiple workspace-specific URLs, users can log in once using a single custom U...
I've also landed on the community page after trying to get the custom-url to work. In the accounts console itself the option is mentioned, but it seems it's unavailable for our account at the moment. Are there any prerequisites except for the ones in...
Databricks has already renamed 34+ products and features, and some of them have changed names more than once.If you've ever wondered:"Is it still Mosaic AI Vector Search or AI Search?""What's the current name of Genie Spaces?""Wasn't this called some...
In the Lakebase project, we can enable Lakebase Search. Lakebase Search is Databricks’ managed search capability for Lakebase projects. Under the hood, it exposes two Postgres extensions: lakebase_vector, which adds approximate nearest-neighbor vecto...
Genie FamilyThink of the Genie family as a team of specialists. Each member has a different responsibility, but they all collaborate using the same trusted data.Article Link:Understanding the Databricks Genie Family: Which Genie Is Right for You? @mv...
This is one of those Databricks concepts that becomes very easy once you stop thinking about features and start thinking about “Do I want to move the data or not?As a data engineer, think:Query Federation = “Read remotely.”Lakeflow Connect = “Bring t...
Foreign Tables in Databricks are part of Lakehouse Federation and allow you to query data that lives outside Databricks without copying it into Delta tables first. Think of them as a Unity Catalog object that points to an external system.Let’s unders...
Lakehouse indexes allow not only to skip files during read but also, thanks to row-level tracking id to go directly to the given row and skip scanning other rows in the file. #databricks
https://www.sunnydata.ai/blog/databricks-full-text-search-index...