Databricks Community

Ashwin_DSA

In Part 1, we covered why multi-table transactions matter. Now let's build one. We'll create the tables from the claim wrap-up scenario, load sample P&C insurance data, and walk through what happens when the wrap-up succeeds, when it fails, and when...

Ashwin_DSA

If you've ever built a dashboard where you needed to track the same data across two different date dimensions, you know the frustration. You get the first chart working. You add the second. Then you realise cross-filtering just stopped working. I re...

Ashwin_DSA

I’ve spent the last few years jumping between insurance, healthcare, and retail, and I’ve come to a very painful conclusion that we should never have let humans type their own addresses into a text box.  For a pet project, I’m currently looking at a...

Ashwin_DSA

If you've ever worked on an insurance data warehouse, or really any warehouse where data arrives from different systems at different times, you know the pain of keeping things in sync. I spent years building data warehouses for a property and casual...

Ashwin_DSA

Hi @greengil, Have you considered Lakeflow Connect? Databricks now has a native Jira connector in Lakeflow Connect that can achieve what you are looking for. It's in beta, but something you may want to consider. It ingests Jira into Delta with incr...

Ashwin_DSA

Hi @muaaz, On GCP Databricks, the SQL pattern you are using is fine, but the recommended best practice is to back it with a Unity Catalog external location instead of pointing tables directly at arbitrary gs:// paths. In practice, that means first cr...

Ashwin_DSA

Hi @IM_01, Here is a simple example.. %sql CREATE SCHEMA IF NOT EXISTS uc_customer_demo_catalog.metric_demo; CREATE OR REPLACE TABLE uc_customer_demo_catalog.metric_demo.orders ( order_id INT, order_date DATE, country STRING, product ...

Ashwin_DSA

Hi @IM_01, Yes. Metric views are explicitly designed to give you SQL cube-like behaviour. A metric view lets you define measures once, independent of dimensions, then aggregate those measures over any combination of dimensions at query time, which is...

Ashwin_DSA

Hi @IM_01, event_log(TABLE(...)) always returns the entire pipeline’s event log, not just rows for that one dataset. Passing a table is just a shortcut to find the owning pipeline. It doesn’t filter the log to that table. To restrict to a specific ta...

Databricks Community

User Stats

User Activity

Databricks Multi-Table Transactions - Part 2

Solving Multi-Dimension Analytics in Databricks Dashboards with Views and Metric Views

Is Address Line 4 the place where data goes to die?

Databricks Multi-Table Transactions - Part 1

Re: Delta Jira data import to Databricks

Re: Registering Delta tables from external storage GCS , S3 , Azure Blob in Databricks Unity Catalog

Re: Can metric views be used to achieve sql cube functionality

Re: Can metric views be used to achieve sql cube functionality

Re: Lakeflow SDP expectations