JEAG
New Contributor III

Thxs for your answers

About the enviroment, we are running batch jobs in Databricks Runtime Version 6.4, with Apache Spark 2.4.5 and our code is written in Python 3.7.6

Today we realize that all ours error are taking place in the same storage account, but in diferent files and diferent jobs as I told you before

Is it possible that the error could be a overload of the storage?

I find a file "_commited_vacuum" in the parquet directory which cause a error, what does it mean?