cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Error while reading file deletion_vector_5274904e-d64e-44e9-9a4b-1d7e93dfdc0b.bin

luckydatabricks
New Contributor

org.apache.spark.sql.streaming.StreamingQueryException: [STREAM_FAILED] Query [id = c981c01f-d84b-4f2b-8b78-c7324cd7e752, runId = 7bdd53a0-0d2b-4456-aad8-734e82116c1d] terminated with exception: [FAILED_READ_FILE.NO_HINT] Error while reading file abfss://REDACTED_CREDENTIALS(90ce356b)@a07prdukcoredatadls.dfs.core.windows.net/deltalake/ledgerjournaltrans_partitioned/temporary_DLNnsQMh8Dsb/deletion_vector_5274904e-d64e-44e9-9a4b-1d7e93dfdc0b.bin. SQLSTATE: KD001 SQLSTATE: XXKST
=== Streaming Query ===
Identifier: d365_ledgerjournaltrans [id = c981c01f-d84b-4f2b-8b78-c7324cd7e752, runId = 7bdd53a0-0d2b-4456-aad8-734e82116c1d]
Current Start Offsets: {CloudFilesSource[abfss://dataverse-landsec-unq6c7ff6da72a7ef118a676045bd0b2@a07prdukcoredatadls.dfs.core.windows.net/deltalake/ledgerjournaltrans_partitioned/]: {"seqNum":1731,"sourceVersion":3,"lastBackfillStartTimeMs":1775041145551,"lastBackfillFinishTimeMs":1775041170804,"lastInputPath":"abfss://dataverse-landsec-unq6c7ff6da72a7ef118a676045bd0b2@a01prdukcoredatadls.dfs.core.windows.net/deltalake/ledgerjournaltrans_partitioned/"}}

Can somebody help me this ?

1 REPLY 1

MoJaMa
Databricks Employee
Databricks Employee

Tough to say from just this. You should create a support ticket with MSFT.

Possible the deletion vector file was deleted out from under Auto Loader mid-read. Which might be a bug or it could be that you have some separate cleanup running at the same time which is removing files without the context of why the files exist.

Some other possibilities here based on that SQL Error Code: 

https://learn.microsoft.com/en-us/azure/databricks/error-messages/failed-read-file-error-class