06-04-2024 07:55 AM
I'm curious, is DLT *required* to use Materialized Views in Databricks? Is it not possible to create and refresh a Materialized view via a standard Databricks Workflow?
06-04-2024 08:30 AM
Hi @ChristianRRL,
There are DLT materialized views: https://docs.databricks.com/en/delta-live-tables/index.html#materialized-view
and
Databricks SQL Materialized Views: https://docs.databricks.com/en/sql/user/materialized-views.html#use-materialized-views-in-databricks....
06-04-2024 01:03 PM
Hi @raphaelblg , sorry but I think you misunderstood my question. I'm aware that I can create a DLT pipeline from scratch to create Materialized Views, but I was surprised when I was attempting to create a Materialized View without trying to use DLT, but when I ran this in a standard notebook (connected to our configured cluster) I see that it does seem require DLT:
My question is, either via a Python or SQL notebook cell, can I (1) create, and (2) refresh a Materialized View without requiring DLT at all???
06-04-2024 01:07 PM
For additional clarity, I would like to show that when I attempt to run this in the SQL Editor with the SQL Starter Warehouse, I get an error because we do not have UC enabled. But I'm wanting to get the Materialized View functionality without fully requiring DLT or UC:
06-04-2024 01:50 PM
@ChristianRRL, You either need a DLT pipeline or a SQL Warehouse with UC access.
"In Databricks SQL, materialized views are Unity Catalog managed tables that allow users to precompute results based on the latest version of data in source tables. ".
At: https://docs.databricks.com/en/sql/user/materialized-views.html#what-are-materialized-views
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.
If there isn’t a group near you, start one and help create a community that brings people together.
Request a New Group