cancel
Showing results for 
Search instead for 
Did you mean: 
Knowledge Sharing Hub
Dive into a collaborative space where members like YOU can exchange knowledge, tips, and best practices. Join the conversation today and unlock a wealth of collective wisdom to enhance your experience and drive success.
cancel
Showing results for 
Search instead for 
Did you mean: 

Databricks java.util.NoSuchElementException: None.get Error on "SHOW TABLES IN" command

pavlosskev
New Contributor III

This is not a question, this is just the solution to a problem we encountered in case someone from the community finds it useful.

Recently we encountered an issue, where our users' jobs started failing out of nowhere on the following command, with the error: java.util.NoSuchElementException: None.get

 

spark.sql("SHOW TABLES in catalog.bucket")

 

Solution: Use DBR version 11.3 and above.

Root Cause

For us the reason for the failures in 10.4 DBR and below was that in the target catalog and bucket, there were some new types of tables which were used for LLM projects (vector indexes of type Delta Sync). If we would try to "DESCRIBE" that vector index with DBR 10.4, we would get the below error. This was also the cause for the error mentioned above.

pavlosskev_0-1722501323223.png

 

0 REPLIES 0

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group