Managed Tables, External Tables, Foreign Tables and... .. Catalog Managed Tables. If you are databricks user, you need to know why they are the best of all! https://databrickster.medium.com/catalog-commits-make-your-managed-delta-layer-safer-and-more...
If you don’t know which permissions (scopes) to add to the access token (since some processes can require many scopes), just set access tokens to auto-scoping, and after 30 days, it will set the required scope based on usage during the first 30 days....
If you deploy a bundle from the UI in development mode (source-linked deployment) and edit it in the UI, changes are now propagated to the files. Really useful for jobs and dashboards. For jobs, of course, please always review in GIT as results in so...
Catalog Commits are here, and they are bringing to databricks and UC: - concurrency control, because Unity Catalog coordinates the winning commit- governance, because supported clients resolve table state through Unity Catalog- lays the foundation fo...
Lakebase can scale up more, and Apps are now getting horizontal scaling. Seems like #databricks is the best place to run your app now, any app. https://databrickster.medium.com/databricks-news-cli-v-1-0-0-ai-tools-last-updated-25th-may-767ef39abe8a
Databricks published a list of its own runtimes as Docker images, but what is amazing is that it is not only the standard runtime but also some versions of runtimes, including my two favorites, minimal and version-matching serverless environment, and...
Now, using CLI, it is easy to generate databricks skills for your favorite agent. Just hit databricks aitools install #databricks https://databrickster.medium.com/databricks-news-cli-v-1-0-0-ai-tools-last-updated-25th-may-767ef39abe8a
Databricks CLI and DABs are generally available, and the first version has been released! #databrickshttps://databrickster.medium.com/databricks-news-cli-v-1-0-0-ai-tools-last-updated-25th-may-767ef39abe8a
Stop copy-pasting job parameters between your DABS. Especially ones for the catalog and schema. Just read about mutators! #databricks https://databrickster.medium.com/global-job-parameters-thanks-to-dabs-mutators-2ad0d94bda1c https://www.sunnydata.ai...
Global job parameters were always my dream. Additionally, centralized config for DABs. It is now possible thanks to Mutators! #databricks https://databrickster.medium.com/global-job-parameters-thanks-to-dabs-mutators-2ad0d94bda1chttps://www.sunnydata...
It starts to look busy in Genie One Menu #databricks https://databrickster.medium.com/databricks-news-lakeflow-designer-uv-package-manager-genie-tasks-disable-lakeflow-tasks-3e2cfb9ef86b
We can configure a folder in Workspace for custom DABs templates. If we click Create Bundle in the git repo, we can use our ready DABs template. #databricks https://databrickster.medium.com/databricks-news-lakeflow-designer-uv-package-manager-genie-t...
Report every week for the given topic, now it is really easy, just ask for it! #databricks https://databrickster.medium.com/databricks-news-lakeflow-designer-uv-package-manager-genie-tasks-disable-lakeflow-tasks-3e2cfb9ef86b
In a serverless environment 5 (soon, probably in other environments as well), we can also install packages using the UV package manager. Tests show that it is even a few times faster! #databricks https://medium.com/@databrickster/databricks-news-lake...
