Managed Delta Table corrupted

Rafael-Sousa
Contributor II

‎02-07-2025 06:17 AM

Hey guys,

Recently, we have add some properties to our delta table and after that, the table shows error and we cannot do anything. The error is that: (java.util.NoSuchElementException) key not found: spark.sql.statistics.totalSize

I think maybe this is a bug related to spark connect client in databricks.

Rafael Sousa
0 Kudos

Alberto_Umana
Databricks Employee
Databricks Employee

‎02-07-2025 06:26 AM

Hi @Rafael-Sousa,

This issue can occur when certain statistics are missing or not properly updated in the Delta table's metadata.

You can try to manually update the statistics for the Delta table. This can be done by running the ANALYZE TABLE command to compute statistics for the table:

 

ANALYZE TABLE your_table_name COMPUTE STATISTICS;
 
0 Kudos

Rafael-Sousa
Contributor II

‎02-07-2025 06:53 AM

Hey @Alberto_Umana ,

The problem is that I am not able to run this commando too. The error persists for any kind of operation that I try to run on the table.

Rafael Sousa
0 Kudos

Alberto_Umana
Databricks Employee
Databricks Employee

‎02-07-2025 09:06 AM

Hi @Rafael-Sousa,

Could you please raise a support case for this, to investigate this further?

help@databricks.com

0 Kudos