DLT Pipeline issue

[manjeetgahlawat]

Hello Everyone,

I have setup a DLT pipeline and while running it first time, I am getting the below issue:

key not found: test_bronze_dlt

NoSuchElementException

key not found: test_bronze_dlt

test_bronze_dlt - this my DLT table name that is expected to be created in a bronze schema.

I have verified that volume path exists in landing layer. DLT pipeline is able to create schema, but no progress after that.

There is no other details except this message in the logs.

[K_Anudeep]

Hello @manjeetgahlawat ,

NoSuchElementException: key not found: test_bronze_dlt occurs when the table/view in the pipeline references a LIVE dataset named test_bronze_dlt, but DLT cannot find a dataset with that exact name in the pipeline graph. (So it never even gets to “reading files from the landing volume”.)

You might have defined it as a qualified name like bronze.test_bronze_dlt (or catalog.bronze.test_bronze_dlt) but downstream code uses dlt.read_stream("test_bronze_dlt") or FROM LIVE.test_bronze_dlt.

If you could provide  (a) the snippet that defines test_bronze_dlt and (b) the first downstream table that reads it we can identify the cause . This is ideally a table definition issue.