Please follow https://medium.com/databrickscommunity for the best articles about Databricks.We welcome contributions from anyone in the Databricks community. Submit your first article as a guest (follow us, and in the article menu, choose “submit to ...
As someone who spends hours every day building notebooks, debugging pipelines, and experimenting with AI agents in Databricks, there was always one thought in the back of my mind.“Why can’t Genie Code have a full-screen workspace where I can manage e...
Databricks Apps run 24/7 with no native scale-to-zero. ~$350/mo per app (720 hrs), but internal dashboards/admin tools only get used a few hours/day. You pay for 100%, use ~15%.We had a test app run idle for 69 days before anyone noticed. ~$800 waste...
Databricks LakeWatch- Security for the Agentic Era:What is Lakewatch?Lakewatch is a new security product, essentially a comprehensive security camera system for your entire company’s computer systems, powered by AI.Two significant developments occurr...
Databricks Genie vs Databricks Genie Code – What's the Difference?Many people assume Genie and Genie Code are the same, but they are designed for completely different audiences and use cases.GenieWho it’s for: All employees, from Marketing Managers t...
You can now embed a Databricks Genie Space directly into an external website or application.What does this mean?Instead of asking your business users to log into Databricks every time they want to query data, you can bring Genie to them right inside ...
Azure Databricks now allows organisations to configure a custom URL at the account level, providing a unified and branded access point for all users.Instead of navigating multiple workspace-specific URLs, users can log in once using a single custom U...
The article on Medium includes a diagram that involves Azure Application Gateway, but Databricks' own documentation seems to suggest a quite different setup:https://learn.microsoft.com/en-us/azure/databricks/admin/account-settings/custom-urlAlso, it'...
If you run dozens of scheduled jobs on Databricks, you already know the two native options for catching failures — email/Teams alerts and the Monitoring dashboard — both let you down at scale. You forget to wire up alerts on new jobs, and the dashboa...
Scheduling dashboard updates ensures that your dashboards display up-to-date information and improves performance for end users. Subscriptions keep stakeholders informed by sending dashboard snapshots to email, Slack, or Microsoft Teams. This page ex...
In modern data platforms, real value comes not only from generating insights but also from automating them. Businesses today need reports, KPIs, anomaly detection, and operational intelligence to run continuously without manual intervention.This is w...
The official Databricks Apps quickstart puts everything into a single app.py. Fine for a demo — painful once the app grows past ~500 lines.Problems with the single-file pattern:Merge conflicts on every PRUI, logic, and SDK calls coupled → no unit tes...
Databricks has been rapidly evolving its AI-powered experiences with features like Databricks Assistant, Genie, AI/BI capabilities, and chat-driven interactions. One interesting behaviour many users notice is this:“Why can’t I manually select the SQL...
A behind-the-scenes look at a quiet infrastructure change that cut dashboard load times dramatically and what every BI team should know before their next refresh cycle.For most data teams, Power BI performance problems are framed as a modelling probl...
Databricks One is now Genie. And it's a big deal吏Not just a rebrand. A completely new experience for every employee who has ever been told "you need to ask an analyst for that."Here's what just shipped:Account-Level Genie is GA: one Genie across all...
I recently published a practical write-up on using Databricks + Lovable to quickly turn data processing and ML outputs into a working MVP: Databricks + Lovable: A Practical Case Study of Building an MVP and Managing CostsAt first, I thought the Datab...
