cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

DLT Pipeline does not create the view but it shows up on the DLT graph

aliehs0510
New Contributor

I wanted a more filtered data set from a materialized view so I figured a view might be the solution but it doesn't get created under the target schema  however it shows upon in the graph as a part of the pipeline. Can't we use MVs as data source for views? 

1 REPLY 1

Rishabh-Pandey
Esteemed Contributor

Issue at Hand:

You mentioned that a view is not created under the target schema but appears in the DLT graph. This situation arises due to how DLT manages views and materialized views.

Possible Causes and Solutions:

  1. DLT Execution and Target Schema:

    • In DLT, not all defined views are necessarily materialized under the target schema, especially if they are intermediate or used for transformation purposes.
    • Ensure that the view you are trying to create is explicitly defined to be included in the target schema.
  2. Views on Materialized Views:

    • Using materialized views as a source for defining another view should be possible in DLT. However, ensure the dependency is correctly defined in your DLT pipeline script.
    • Check if the materialized view is correctly named and accessible at the time the subsequent view is created.
  3. Pipeline Definition and Dependencies:

    • Make sure that the view is defined after the materialized view in the pipeline script.
    • Double-check that there are no typos or incorrect references in the view definition.
  4. Pipeline Execution Mode:

    • Verify if the pipeline is running in 'triggered' mode or 'continuous' mode. Some configurations might affect how and when the views and materialized views are created and displayed in the schema.
Rishabh Pandey

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group