3 weeks ago
I'm curious, is DLT *required* to use Materialized Views in Databricks? Is it not possible to create and refresh a Materialized view via a standard Databricks Workflow?
3 weeks ago
@ChristianRRL, You either need a DLT pipeline or a SQL Warehouse with UC access.
"In Databricks SQL, materialized views are Unity Catalog managed tables that allow users to precompute results based on the latest version of data in source tables. ".
At: https://docs.databricks.com/en/sql/user/materialized-views.html#what-are-materialized-views
3 weeks ago
Hi @ChristianRRL,
There are DLT materialized views: https://docs.databricks.com/en/delta-live-tables/index.html#materialized-view
and
Databricks SQL Materialized Views: https://docs.databricks.com/en/sql/user/materialized-views.html#use-materialized-views-in-databricks....
3 weeks ago
Hi @raphaelblg , sorry but I think you misunderstood my question. I'm aware that I can create a DLT pipeline from scratch to create Materialized Views, but I was surprised when I was attempting to create a Materialized View without trying to use DLT, but when I ran this in a standard notebook (connected to our configured cluster) I see that it does seem require DLT:
My question is, either via a Python or SQL notebook cell, can I (1) create, and (2) refresh a Materialized View without requiring DLT at all???
3 weeks ago
For additional clarity, I would like to show that when I attempt to run this in the SQL Editor with the SQL Starter Warehouse, I get an error because we do not have UC enabled. But I'm wanting to get the Materialized View functionality without fully requiring DLT or UC:
3 weeks ago
@ChristianRRL, You either need a DLT pipeline or a SQL Warehouse with UC access.
"In Databricks SQL, materialized views are Unity Catalog managed tables that allow users to precompute results based on the latest version of data in source tables. ".
At: https://docs.databricks.com/en/sql/user/materialized-views.html#what-are-materialized-views
Excited to expand your horizons with us? Click here to Register and begin your journey to success!
Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!