Databricks Community

Ashwin_DSA

I'm currently working with a banking customer migrating from Hive Metastore to Unity Catalog. While planning their catalog layout, one of their platform engineers asked the question that prompted this post: for their schemas and volumes, should th...

Ashwin_DSA

A question came up in the community recently that I thought deserved more than a short answer. The question was around how to build a reliable investigation sequence for slow Spark jobs, specifically when symptoms overlap. A long-running stage with ...

Ashwin_DSA · 05-18-2026

You've spent months planning the migration, the pipelines are built, and data is flowing into the new platform. Then comes the hard part: proving the data actually matches. Business validation and reconciliation is where data migrations fail. Not be...

Ashwin_DSA · 03-28-2026

In Part 1, we covered why multi-table transactions matter. Now let's build one. We'll create the tables from the claim wrap-up scenario, load sample P&C insurance data, and walk through what happens when the wrap-up succeeds, when it fails, and when...

Ashwin_DSA · 03-27-2026

If you've ever built a dashboard where you needed to track the same data across two different date dimensions, you know the frustration. You get the first chart working. You add the second. Then you realise cross-filtering just stopped working. I re...

Ashwin_DSA

Hi @SamuelGTurner, Yes, it was released to beta in April following the original post. Please note that classic compute can only be used with the API. Databricks still recommends using Serverless.

Ashwin_DSA

Hi @charl-p-botha, Azure support channels will typically help you with any blockers or issues you encounter. Since this current behavior is expected for the product, I recommend that you reach out to your account team or the partner channel. This way...

Ashwin_DSA

Hi @Anish_2, The message... Reported flow time metrics for flowName: 'pipelines.flowTimeMetrics.missingFlowName'..is usually not enough on its own to identify the root cause. I would treat it as a metrics/observability signal rather than the primary ...

Ashwin_DSA

Hi @ShaRKS, If you are taking the Associate ML pathway, the notebooks are typically available through the course's lab environment rather than as separate downloadable assets. Databricks course pages for the ML curriculum note that lecture notebooks ...

Ashwin_DSA

Hi @charl-p-botha, Your concern is understandable, and based on the current public documentation, what you are seeing is consistent with how AI/BI dashboard sharing works today. Published AI/BI Dashboards are documented as shareable with users and gr...

Databricks Community

User Stats

User Activity

Managed vs External Storage in Unity Catalog on Azure: Where Should Your Data Live?

Reading Spark UI: A Repeatable Guide to Finding Performance Bottlenecks

Speed Up Data Warehouse Migration Validation

Databricks Multi-Table Transactions - Part 2

Solving Multi-Dimension Analytics in Databricks Dashboards with Views and Metric Views

Re: Is it required to run Lakeflow Connect on Serverless?

Re: How to limit the AI/BI dashboard sharing people-picker to workspace members

Re: Intialization stage is taking time in lakehouse pipeline

Re: Notebooks for Labs

Re: How to limit the AI/BI dashboard sharing people-picker to workspace members