Delta table cannot be reached with INTERNAL_ERROR

[NataliaCh]

Hi all!

I've been dropping and recreating delta tables at the new location. For one table something went wrong and now I cannot nor DROP nor recreate it. It is visible in catalog, however, when I click on the table I see message: [INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. You hit a bug in Spark or the Spark plugins you use. Please, report this bug to the corresponding communities or vendors, and provide the full stack track.

I tried to connect with different cluster or end point, but it didnt work. I also tried to delete all the table files from the storage account, and I tried to replace the table files with files from backup but that didnt change anything.

Anyone had similar issue?

Thanks in advance,

Natalia

[Kaniz_Fatma]

I’m sorry to hear that you’re encountering this issue with your Delta table.

• Ensure that you are using a compatible version of Spark and its associated plugins. Sometimes, upgrading or downgrading Spark can resolve issues related to internal errors.
• Verify that any custom plugins or libraries you’re using are compatible with your Spark version.
• Double-check the query you’re using to create or drop the Delta table. Sometimes, syntax errors or unsupported operations can trigger internal errors.
• If possible, try simplifying the query to isolate the issue.

Good luck, and I hope you find a solution soon! 😊¹²

If you have any additional information or specific details about your setup, feel free to share, and I’ll do my best to assist further.