In this video, I will show you how to seamlessly publish your Azure Databricks data directly to Power BI Online, eliminating the need for complex export-import workflows.You'll learn how to configure the necessary permissions, set up Unity Catalog i...
Install databricks extension in Google Sheets, now it has a new cool functionality which allows generating pivots connected to UC data #databricks https://databrickster.medium.com/databricks-news-2026-week-6-2-february-2026-to-8-february-2026-1ae1630...
I originally wanted to publish this as a LinkedIn article.But as many of you know, the LinkedIn engine doesn’t really promote long-form articles anymore, so I turned it into a post instead.As we mark 25 years of the Agile Manifesto, I’ve been reflect...
MlFlow 3.9 introduces low-code, easy-to-implement LLM judges #databricks https://databrickster.medium.com/databricks-news-2026-week-6-2-february-2026-to-8-february-2026-1ae163015764
Now, metric views can be materialized; this way, you can speed up the performance of your dashboards or Genie. #databricks https://medium.com/@databrickster/databricks-news-2026-week-5-26-january-2026-to-1-february-2026-d05b274adafe
Traces allow us to log information to experiments in AI/ML projects. Now it is possible to save it directly to Unity Catalog using the OpenTelemetry standard via Zerobus. #databricks https://medium.com/@databrickster/databricks-news-2026-week-5-26-ja...
Now, directly in Asset Bundles, we can add config for our apps #databricks more https://databrickster.medium.com/databricks-news-2026-week-3-12-january-2026-to-18-january-2026-5d87e517fb06
DAB entry point is simplified to just one file - databricks.yml. Thank you for sharing.
The role of the data engineer has fundamentally changed.Sustainable AI success no longer depends on isolated models or experimental pilots. It depends on data engineers who can design, govern, and operate AI ready platforms at scale. The shift is fro...
This is a timely reminder that durable, responsible AI isn’t about chasing the latest model — it starts with strong fundamentals: high-quality data, sound governance, cross-functional collaboration, and a commitment to continuous learning. Investing ...
One of my favorite new additions to databricks, especially useful if you work on a few projects in the same workspace. You can easily restore tabs from previous sessions. #databricks https://databrickster.medium.com/databricks-news-2026-week-5-26-jan...
At Databricks, more and more teams are starting to use Lakeflow (Jobs & Pipelines), and some companies use it primarily for orchestrating scripts in Databricks. It's a powerful tool for building dependencies, but as the number of jobs grows, problems...
full text: https://medium.com/@protmaks/api-monitoring-of-scheduled-jobs-33a221d9f891
If you need to refresh the pipeline from SQL, it is good to add ASYNC so you do not lock the SQL Warehouse during the refresh. #databricks https://databrickster.medium.com/databricks-news-2026-week-5-26-january-2026-to-1-february-2026-d05b274adafe
You can productize your Databricks dashboards with proper CI/CD practices. From git integration to DABS parametrization and deployment #databricks https://databrickster.medium.com/deploy-your-databricks-dashboards-to-production-a4c380315f1f https://w...
Thanks for sharing @Hubert-Dudek !
Initial loads can be a total nightmare. Imagine that every day you ingest 1 TB of data, but for the initial load, you need to ingest the last 5 years in a single pass. Roughly, that’s 1 TB × 365 days × 5 years = 1825 TB of data. The new row_filter se...
NEW UPDATED UI OlD UIThe new Genie interface offers a clean and intuitive experience.It feels more spacious and less cluttered, with noticeably smoother navigation.What do you think?Which UI do you like more, the old one or the new one?#MVP
the new one
One of the key challenges is limiting the number of updates—especially when there are many consecutive inserts (e.g., from Zerobus). The AT MOST EVERY option in Databricks pipeline objects helps batch frequent events into controlled updates, reducing...
