In this video, I'm going to show you how to automate resource creation in Azure Databricks using the Databricks SDK for Python. If you've ever found yourself manually creating catalogs, schemas, and volumes in the Databricks UI repeatedly, this video...
Databricks Apps run 24/7 with no native scale-to-zero. ~$350/mo per app (720 hrs), but internal dashboards/admin tools only get used a few hours/day. You pay for 100%, use ~15%.We had a test app run idle for 69 days before anyone noticed. ~$800 waste...
Seems there is so much confusion on the upcoming Genie pricing.Databricks Genie pricing, made simple:Free monthly usage stays Only usage beyond it is billed (DBUs)Paid starts July 6, 2026Admins set budgets to cap spendGenie did NOT become paid-only. ...
If you don’t know which permissions (scopes) to add to the access token (since some processes can require many scopes), just set access tokens to auto-scoping, and after 30 days, it will set the required scope based on usage during the first 30 days....
Databricks LakeWatch- Security for the Agentic Era:What is Lakewatch?Lakewatch is a new security product, essentially a comprehensive security camera system for your entire company’s computer systems, powered by AI.Two significant developments occurr...
Databricks Genie vs Databricks Genie Code – What's the Difference?Many people assume Genie and Genie Code are the same, but they are designed for completely different audiences and use cases.GenieWho it’s for: All employees, from Marketing Managers t...
You can now embed a Databricks Genie Space directly into an external website or application.What does this mean?Instead of asking your business users to log into Databricks every time they want to query data, you can bring Genie to them right inside ...
If you deploy a bundle from the UI in development mode (source-linked deployment) and edit it in the UI, changes are now propagated to the files. Really useful for jobs and dashboards. For jobs, of course, please always review in GIT as results in so...
Catalog Commits are here, and they are bringing to databricks and UC: - concurrency control, because Unity Catalog coordinates the winning commit- governance, because supported clients resolve table state through Unity Catalog- lays the foundation fo...
Lakebase can scale up more, and Apps are now getting horizontal scaling. Seems like #databricks is the best place to run your app now, any app. https://databrickster.medium.com/databricks-news-cli-v-1-0-0-ai-tools-last-updated-25th-may-767ef39abe8a
Databricks continues to enhance data governance and observability with the introduction of Column Popularity in Unity Catalog's Catalog Explorer. This new capability provides data teams with visibility into which columns are queried most frequently a...
If you run dozens of scheduled jobs on Databricks, you already know the two native options for catching failures — email/Teams alerts and the Monitoring dashboard — both let you down at scale. You forget to wire up alerts on new jobs, and the dashboa...
Databricks published a list of its own runtimes as Docker images, but what is amazing is that it is not only the standard runtime but also some versions of runtimes, including my two favorites, minimal and version-matching serverless environment, and...
Now, using CLI, it is easy to generate databricks skills for your favorite agent. Just hit databricks aitools install #databricks https://databrickster.medium.com/databricks-news-cli-v-1-0-0-ai-tools-last-updated-25th-may-767ef39abe8a
Databricks CLI and DABs are generally available, and the first version has been released! #databrickshttps://databrickster.medium.com/databricks-news-cli-v-1-0-0-ai-tools-last-updated-25th-may-767ef39abe8a
