Stop copy-pasting job parameters between your DABS. Especially ones for the catalog and schema. Just read about mutators! #databricks https://databrickster.medium.com/global-job-parameters-thanks-to-dabs-mutators-2ad0d94bda1c https://www.sunnydata.ai...
I watched Databricks CEO, Ali Ghodsi’s interview on Mad Money, with Jim Cramer, and was inspired by a point that aligns closely with what we hear from clients every day: “AI doesn’t have an intelligence problem. It has a context problem.”That is exac...
In modern data platforms, real value comes not only from generating insights but also from automating them. Businesses today need reports, KPIs, anomaly detection, and operational intelligence to run continuously without manual intervention.This is w...
About three years ago, when Generative AI was still in its early stages, I worked on a commercial application for insurance underwriting. It was a Life Insurance Underwriting assistant built on an early version of GPT-4 (1106).The design was simple. ...
In one of the recent issue of The Batch, Andrew Ng argues that voice UIs will become as ubiquitous as the mouse and touchscreen - and highlights Vocal Bridge, an agentic voice platform, as an example of the infrastructure making this possible. To dem...
Global job parameters were always my dream. Additionally, centralized config for DABs. It is now possible thanks to Mutators! #databricks https://databrickster.medium.com/global-job-parameters-thanks-to-dabs-mutators-2ad0d94bda1chttps://www.sunnydata...
It starts to look busy in Genie One Menu #databricks https://databrickster.medium.com/databricks-news-lakeflow-designer-uv-package-manager-genie-tasks-disable-lakeflow-tasks-3e2cfb9ef86b
Finally had a time to play around with Databricks AI Dev Kit and Claude Code. Hopefully, you will learn something new. Cheers!Linkedin post:https://www.linkedin.com/posts/sudarshan-koirala_databricks-claudecode-genai-share-7461853680783388672-1eLb?ut...
We can configure a folder in Workspace for custom DABs templates. If we click Create Bundle in the git repo, we can use our ready DABs template. #databricks https://databrickster.medium.com/databricks-news-lakeflow-designer-uv-package-manager-genie-t...
Report every week for the given topic, now it is really easy, just ask for it! #databricks https://databrickster.medium.com/databricks-news-lakeflow-designer-uv-package-manager-genie-tasks-disable-lakeflow-tasks-3e2cfb9ef86b
We run a large-scale retail analytics platform in the CPG domain on AWS Databricks, and for a long time we lived with an architectural compromise most data teams know well — a lakehouse for analytics, and a separate operational database for everythin...
In a serverless environment 5 (soon, probably in other environments as well), we can also install packages using the UV package manager. Tests show that it is even a few times faster! #databricks https://medium.com/@databrickster/databricks-news-lake...
The official Databricks Apps quickstart puts everything into a single app.py. Fine for a demo — painful once the app grows past ~500 lines.Problems with the single-file pattern:Merge conflicts on every PRUI, logic, and SDK calls coupled → no unit tes...
Lakehouse Sync replicates data from Lakebase/Postgres directly into Unity Catalog Delta tables. It uses CDC from PostgreSQL WAL, with wal2delta doing the work. #databricks
Databricks has been rapidly evolving its AI-powered experiences with features like Databricks Assistant, Genie, AI/BI capabilities, and chat-driven interactions. One interesting behaviour many users notice is this:“Why can’t I manually select the SQL...
