cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Materialized Views Without DLT?

ChristianRRL
Contributor II

I'm curious, is DLT *required* to use Materialized Views in Databricks? Is it not possible to create and refresh a Materialized view via a standard Databricks Workflow?

1 ACCEPTED SOLUTION

Accepted Solutions

@ChristianRRL, You either need a DLT pipeline or a SQL Warehouse with UC access.

"In Databricks SQL, materialized views are Unity Catalog managed tables that allow users to precompute results based on the latest version of data in source tables. ".

At: https://docs.databricks.com/en/sql/user/materialized-views.html#what-are-materialized-views

 

Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks

View solution in original post

4 REPLIES 4

raphaelblg
Contributor III
Contributor III

Hi @ChristianRRL,

There are DLT materialized views: https://docs.databricks.com/en/delta-live-tables/index.html#materialized-view

and

Databricks SQL Materialized Views: https://docs.databricks.com/en/sql/user/materialized-views.html#use-materialized-views-in-databricks....

Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks

Hi @raphaelblg , sorry but I think you misunderstood my question. I'm aware that I can create a DLT pipeline from scratch to create Materialized Views, but I was surprised when I was attempting to create a Materialized View without trying to use DLT, but when I ran this in a standard notebook (connected to our configured cluster) I see that it does seem require DLT:

ChristianRRL_0-1717531327932.png

My question is, either via a Python or SQL notebook cell, can I (1) create, and (2) refresh a Materialized View without requiring DLT at all???

ChristianRRL
Contributor II

For additional clarity, I would like to show that when I attempt to run this in the SQL Editor with the SQL Starter Warehouse, I get an error because we do not have UC enabled. But I'm wanting to get the Materialized View functionality without fully requiring DLT or UC:

ChristianRRL_1-1717531520367.png

 

@ChristianRRL, You either need a DLT pipeline or a SQL Warehouse with UC access.

"In Databricks SQL, materialized views are Unity Catalog managed tables that allow users to precompute results based on the latest version of data in source tables. ".

At: https://docs.databricks.com/en/sql/user/materialized-views.html#what-are-materialized-views

 

Best regards,

Raphael Balogo
Sr. Technical Solutions Engineer
Databricks
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!