Error while reading file . [DEFAULT_FILE_NOT_FOUND]

The_raj — Wed, 26 Jul 2023 07:42:33 GMT

Hi,

I have a workflow created where there are 5 notebooks in it. One of the notebooks is failing with below error. I have tried refreshing the table. Still facing the same issue. When I try to run the notebook manually, it works fine. Can someone please help me to find the permanent solution for this.

Job aborted due to stage failure: Task 736 in stage 92.0 failed 4 times, most recent failure: Lost task 736.3 in stage 92.0 (TID 3715) (executor 18): com.databricks.sql.io.FileReadException: Error while reading file <path>. [DEFAULT_FILE_NOT_FOUND] It is possible the underlying files have been updated. You can explicitly invalidate the cache in Spark by running 'REFRESH TABLE tableName' command in SQL or by recreating the Dataset/DataFrame involved. If disk cache is stale or the underlying files have been removed, you can invalidate disk cache manually by restarting the cluster.

Hubert_Dudek1 werners1 @Prabakar @Debayan daniel_sahal

topic Error while reading file <file path>. [DEFAULT_FILE_NOT_FOUND] in Data Engineering

Error while reading file . [DEFAULT_FILE_NOT_FOUND]