Secret magic commands, there are a lot of them. Check my blogs to see which one can simplify your daily work. First one is %%writefile, which can be used to write a new file, for example, another notebook #databricks more magic commands:- https://dat...
I’ve seen many examples of AI that can help you code individual routines and such, mostly junior-level coding help. The goal of this POC is to give the AI a general PRD containing coding examples and have it generate a Databricks pipeline from such.R...
Runtime 18 / Spark 4.1 brings parameter markers everywhere #databricks Latest updates: read: https://databrickster.medium.com/databricks-news-week-1-29-december-2025-to-4-january-2025-432c6231d8b1 watch:https://www.youtube.com/watch?v=LLjoTkceKQI
Databricks has introduced a powerful feature—Metric Views—that transforms how organizations define, manage, and consume business metrics. Whether you're a data analyst, engineer, or business stakeholder, Metric Views offer a unified, governed, and re...
@BijuThottathil : I don't have a workaround for you, but wanted to let you know that you can vote here https://community.fabric.microsoft.com/t5/Fabric-Ideas/Enable-native-Power-BI-integration-with-Databricks-Metric-View/idi-p/4823684Hopefully, Micro...
Databricks Microsoft Fabric: Zero-Copy Integration with Delta SharingManaging data across different ecosystems usually means messy ETL pipelines and high storage costs. I implemented a Zero-Copy architecture to streamline this. By leveraging Delta S...
Runtime 18 / Spark 4.1 brings Literal string coalescing everywhere, thanks to what you can make your code more readable. Useful, for example, for table comments #databricks Latest updates: read: https://databrickster.medium.com/databricks-news-week-1...
We can see new grant types in Unity Catalog. It seems that secrets are coming to UC, and I especially love the "Reference Secret" grant. #databricks Read more:- https://databrickster.medium.com/databricks-news-week-1-29-december-2025-to-4-january-202...
DABS deployment from a JSON plan is one of my favourite new options. You can review the changes or even integrate the plan with your CI/CD process. #databricks Read more:- https://databrickster.medium.com/databricks-news-week-1-29-december-2025-to-4-...
I read about a team demo about their shiny new "autonomous AI agent” leadership. It queried databases, generated reports, sent Slack notifications—all hands-free. Impressive stuff. Two weeks later? $12K in API costs, staging data accidentally pushed ...
We can ingest Excel into Databricks, including natively from SharePoint. It was top news in December, but in fact is part of a big strategy which will allow us to ingest any format from anywhere in databricks. Foundation is already built as there is ...
This use case demonstrates how a SaaS product can be deployed for multiple customers or business units, ensuring data isolation at every layer through workspace separation, fine-grained access control with Unity Catalog, and secure processing using U...
Good breakdown of the Databricks storage and catalog isolation patterns.One thing to keep in mind: workspace binding and Unity Catalog handle data isolation well, but the authentication layer is where tenant context gets established first. Without pr...
Dashboards now offer more flexibility, allowing us to use another field or expression to label or sort the chart. See demo at:- https://www.youtube.com/watch?v=4ngQUkdmD3o&t=893s- https://databrickster.medium.com/databricks-news-week-52-22-december-2...
We’ve recently created a new Excel reader function, and I decided to have a play around with it. I’ve used an open dataset for this tutorial, so you can follow along too. Using file available here - https://www.ons.gov.uk/employmentandlabourmarket/pe...
Nice example!
When something goes wrong, and your pattern involves daily MERGE operations in your jobs, backfill jobs let you reload multiple days in a single execution without writing custom scripts or manually triggering runs. Read more:- https://www.sunnydata.a...
More and more resources are available under DABS. One of the newest additions is the alerts resource.
| User | Count |
|---|---|
| 85 | |
| 71 | |
| 47 | |
| 44 | |
| 42 |
