- 107 Views
- 2 replies
- 8 kudos
How can I tell my Dashboard visualizations aren't stale?
With AI/BI Dashboards, a best practice is for the creator/owner to 'Schedule' the Dashboard to rerun the underlying datasets when changes have occurred. This ensures the Visualizations are rendered with the freshest data. But users still will questi...
- 107 Views
- 2 replies
- 8 kudos
- 8 kudos
@mark_ott That is a nice idea and quite useful. Quick question: how did you define 'stale' data in your case? So what is the threshold at which your 'conditional equation' color codes the date red? did you somehow link that to the refresh schedule?
- 8 kudos
- 88 Views
- 1 replies
- 3 kudos
The Last Mile of Data Intelligence - Databricks Lakebase
We spent the last decade building a wall in the middle of the data stack. Data Lakehouse on one side - massive, powerful & analytical. The Operational Database on the other - fast, transactional, and vital for apps. The separation created a “last mil...
- 88 Views
- 1 replies
- 3 kudos
- 3 kudos
Great framing, @balajij8 . The “last mile” analogy really lands — especially for anyone who’s spent weeks maintaining brittle reverse ETL pipelines just to get insights back into an app where they can actually be used. Bringing an ACID-compliant Post...
- 3 kudos
- 628 Views
- 5 replies
- 4 kudos
The End of an Era - Azure Databricks is Retiring the Standard Tier
Microsoft announced the retirement plan for the Azure Databricks Standard tier. This is vital information for Organizations still on the Standard Tier. It represents a fundamental architectural realignment that Organizations must navigate with precis...
- 628 Views
- 5 replies
- 4 kudos
- 4 kudos
Any reason why it is being planned to retire this Standard Tier by Azure Databricks?
- 4 kudos
- 2754 Views
- 3 replies
- 4 kudos
Getting Databricks Generative AI Engineer Associate (and What I Learned)
I just earned my Databricks Certified Generative AI Engineer Associate Certification, and in this post, I’m sharing the key tips, resources, and personal insights that helped me succeed. My certiticate from DatabricksNavigation:PreludeAbout the certR...
- 2754 Views
- 3 replies
- 4 kudos
- 4 kudos
Hey @devipriya , thanks for sharing your notes on how you found success with the certification(s). Appreciate you taking the time to pass along what worked for you. Cheers, Louis
- 4 kudos
- 192 Views
- 2 replies
- 2 kudos
Change default workspace access to Consumer access
When Databricks One was launched, the default behaviour of the system-managed users group was a major issue. Since every new user is automatically added to users group, and that group traditionally came with "Workspace Access" entitlements, admins ha...
- 192 Views
- 2 replies
- 2 kudos
- 84 Views
- 0 replies
- 3 kudos
Very short video on tip about Collect() method!!!
Here is a very short video on how to use collect() method with caution as it could overwhelm the cluster in some big data scenarios!!!! Now only in Spanish but I guess youtube will do the trick to translate into very correct English xDD
- 84 Views
- 0 replies
- 3 kudos
- 1022 Views
- 3 replies
- 6 kudos
A Governance-First Unified Namespace:Why Manufacturers Need Unity Catalog to Scale Industry 4.0 Data
The Industrial Data ChallengeManufacturing enterprises today operate with a fundamental paradox: they're drowning in data yet starving for insights. A typical plant generates terabytes of information daily across dozens of systems—from shop floor PLC...
- 1022 Views
- 3 replies
- 6 kudos
- 151 Views
- 1 replies
- 0 kudos
Publish a Technical Blog
Sir/Madam,I hope you are doing well. I would like to contribute and publish a technical blog on the Databricks Community portal. However, I am not sure about the process and appropriate platform. I would appreciate your guidance on where to start, th...
- 151 Views
- 1 replies
- 0 kudos
- 0 kudos
Hello @Saurabh2406! Thanks for showing interest in contributing a technical blog. I’ve sent you a DM with the next steps.
- 0 kudos
- 126 Views
- 0 replies
- 0 kudos
Great Expectations with Fabric and Databricks-Building Bulletproof Data Pipelines
In this article, I’ll walk you through transforming a basic PySpark notebook into a production-ready data pipeline with comprehensive quality checks using Great Expectations patterns in Microsoft Fabric and Databricks. We’ll start simple and progress...
- 126 Views
- 0 replies
- 0 kudos
- 284 Views
- 1 replies
- 1 kudos
Dashboards deployment
It is finally possible to deploy dashboards using DABS and change the catalog and schema. It is solving the biggest problem with bringing the dashboard to production. New parameters for the dashboard resource were added: dataset_catalog and dataset...
- 284 Views
- 1 replies
- 1 kudos
- 1 kudos
@Hubert-Dudek - This was really a much-awaited feature. Eventually DAB must cover all developed assets which requires promotion to higher environment to cover the CICD seamlessly.
- 1 kudos
- 455 Views
- 1 replies
- 1 kudos
PostgreSQL to Databricks made simpler with Lakeflow Connect(Public Preview)
PostgreSQL to Databricks made simpler with Lakeflow Connect (Public Preview).Databricks has introduced a PostgreSQL connector in Lakeflow Connect (Public Preview), enabling ingestion of PostgreSQL data into the Lakehouse using logical replication.Ins...
- 455 Views
- 1 replies
- 1 kudos
- 1 kudos
@Yogesh_Verma_ do you have timeline for when this will be Generally Available?
- 1 kudos
- 217 Views
- 1 replies
- 1 kudos
SQL Scripting - Procedural Logic in Databricks SQL (Without Leaving SQL)
We've all been there. You need to loop through a list of tables, apply some transformation, handle a few edge cases, and maybe catch an error or two. In most data platforms, that means switching to Python or Scala—even if 90% of your logic is just SQ...
- 217 Views
- 1 replies
- 1 kudos
- 1 kudos
Correction: Preview is available on Databricks Runtime 16.3 and above.
- 1 kudos
- 468 Views
- 0 replies
- 2 kudos
Databricks Serverless Compute: Performance, Cost, and Time-to-Value Explained
As data platforms mature, the focus is no longer just scalability—it is about speed, simplicity, and cost efficiency. Engineering teams want to deliver insights faster without managing infrastructure, while organizations want predictable costs and st...
- 468 Views
- 0 replies
- 2 kudos
- 215 Views
- 1 replies
- 1 kudos
Window Functions in Metrics Views
The latest update for the first week of 2026 is the addition of window functions in Metrics View. In enterprises, there are always measures like cumulative sales or rolling forecast, so it is really important that we can use window functions in busin...
- 215 Views
- 1 replies
- 1 kudos
- 1 kudos
@Hubert-Dudek - Thanks for sharing these bite-size updates as these get lost in many release-notes. Keep it up.
- 1 kudos
- 119 Views
- 0 replies
- 2 kudos
Mix Shell with Python
Assigning the result of a shell command directly to a Python variable. It is my most significant finding in magic commands and my favourite one so far. Read about 12 magic commands in my blogs: - https://www.sunnydata.ai/blog/databricks-hidden-magic-...
- 119 Views
- 0 replies
- 2 kudos
