Error while reading file deletion_vector_5274904e-d64e-44e9-9a4b-1d7e93dfdc0b.bin

luckydatabricks
New Contributor

‎04-13-2026 05:59 AM

org.apache.spark.sql.streaming.StreamingQueryException: [STREAM_FAILED] Query [id = c981c01f-d84b-4f2b-8b78-c7324cd7e752, runId = 7bdd53a0-0d2b-4456-aad8-734e82116c1d] terminated with exception: [FAILED_READ_FILE.NO_HINT] Error while reading file abfss://REDACTED_CREDENTIALS(90ce356b)@a07prdukcoredatadls.dfs.core.windows.net/deltalake/ledgerjournaltrans_partitioned/temporary_DLNnsQMh8Dsb/deletion_vector_5274904e-d64e-44e9-9a4b-1d7e93dfdc0b.bin. SQLSTATE: KD001 SQLSTATE: XXKST
=== Streaming Query ===
Identifier: d365_ledgerjournaltrans [id = c981c01f-d84b-4f2b-8b78-c7324cd7e752, runId = 7bdd53a0-0d2b-4456-aad8-734e82116c1d]
Current Start Offsets: {CloudFilesSource[abfss://dataverse-landsec-unq6c7ff6da72a7ef118a676045bd0b2@a07prdukcoredatadls.dfs.core.windows.net/deltalake/ledgerjournaltrans_partitioned/]: {"seqNum":1731,"sourceVersion":3,"lastBackfillStartTimeMs":1775041145551,"lastBackfillFinishTimeMs":1775041170804,"lastInputPath":"abfss://dataverse-landsec-unq6c7ff6da72a7ef118a676045bd0b2@a01prdukcoredatadls.dfs.core.windows.net/deltalake/ledgerjournaltrans_partitioned/"}}

Can somebody help me this ?

0 Kudos

MoJaMa
Databricks Employee
Databricks Employee

‎04-23-2026 07:59 AM

Tough to say from just this. You should create a support ticket with MSFT.

Possible the deletion vector file was deleted out from under Auto Loader mid-read. Which might be a bug or it could be that you have some separate cleanup running at the same time which is removing files without the context of why the files exist.

Some other possibilities here based on that SQL Error Code: 

https://learn.microsoft.com/en-us/azure/databricks/error-messages/failed-read-file-error-class 

0 Kudos