cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 
Help
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results forย 
Search instead forย 
Did you mean:ย 

Delta Live Table pipeline hanging at INITIALIZING forever

bojian_tw
New Contributor

โ€Ž07-26-2024 05:07 PM

I have a dlt pipeline haning at INIALIZING forever, it never stops. 

Screenshot 2024-07-27 at 07.50.31.png

But I found the Analysis Exeption already happened at beginning

pyspark.errors.exceptions.captured.AnalysisException: [UNRESOLVED_COLUMN.WITH_SUGGESTION] A column, variable, or function parameter with name `data`.`Something`.`data` cannot be resolved.

Why the dlt pipeline never stops and report the error as usual? 

 

 

 

0 Kudos
1 REPLY 1

Kaniz_Fatma
Community Manager
Community Manager

โ€Ž07-30-2024 04:46 AM

Hi @bojian_tw, Could you please check that all column names referenced in your pipeline are correct and exist in the source data? The error message indicates that the column data.Something.data cannot be resolved, which suggests a possible typo or a missing column.

0 Kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group
Announcements