cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Delta table cannot be reached with INTERNAL_ERROR

NataliaCh
New Contributor

Hi all!

I've been dropping and recreating delta tables at the new location. For one table something went wrong and now I cannot nor DROP nor recreate it. It is visible in catalog, however, when I click on the table I see message: [INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack track.

I tried to connect with different cluster or end point, but it didnt work. I also tried to delete all the table files from the storage account, and I tried to replace the table files with files from backup but that didnt change anything.

Anyone had similar issue?

Thanks in advance,

Natalia

1 REPLY 1

Kaniz_Fatma
Community Manager
Community Manager

I’m sorry to hear that you’re encountering this issue with your Delta table.

  • Ensure that you are using a compatible version of Spark and its associated plugins. Sometimes, upgrading or downgrading Spark can resolve issues related to internal errors.
  • Verify that any custom plugins or libraries you’re using are compatible with your Spark version.
  • Double-check the query you’re using to create or drop the Delta table. Sometimes, syntax errors or unsupported operations can trigger internal errors.
  • If possible, try simplifying the query to isolate the issue.

Good luck, and I hope you find a solution soon! 😊12

If you have any additional information or specific details about your setup, feel free to share, and I’ll do my best to assist further.

 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group