cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

DLT Pipeline does not create the view but it shows up on the DLT graph

aliehs0510
New Contributor

I wanted a more filtered data set from a materialized view so I figured a view might be the solution but it doesn't get created under the target schema  however it shows upon in the graph as a part of the pipeline. Can't we use MVs as data source for views? 

1 REPLY 1

Rishabh264
Honored Contributor II

Issue at Hand:

You mentioned that a view is not created under the target schema but appears in the DLT graph. This situation arises due to how DLT manages views and materialized views.

Possible Causes and Solutions:

  1. DLT Execution and Target Schema:

    • In DLT, not all defined views are necessarily materialized under the target schema, especially if they are intermediate or used for transformation purposes.
    • Ensure that the view you are trying to create is explicitly defined to be included in the target schema.
  2. Views on Materialized Views:

    • Using materialized views as a source for defining another view should be possible in DLT. However, ensure the dependency is correctly defined in your DLT pipeline script.
    • Check if the materialized view is correctly named and accessible at the time the subsequent view is created.
  3. Pipeline Definition and Dependencies:

    • Make sure that the view is defined after the materialized view in the pipeline script.
    • Double-check that there are no typos or incorrect references in the view definition.
  4. Pipeline Execution Mode:

    • Verify if the pipeline is running in 'triggered' mode or 'continuous' mode. Some configurations might affect how and when the views and materialized views are created and displayed in the schema.
Rishabh Pandey
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!