cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Community Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Method public void org.apache.spark.sql.internal.CatalogImpl.clearCache() is not whitelisted on clas

NhanNguyen
Contributor II

I'm executing a notebook and failed with this error:

Screenshot 2024-04-03 at 21.49.46.png

 

Sometime, when i execute some function in spark and also failed with the error 'this class is not whitelist'. 

Could everyone help me check on this?

Thanks for your help!

2 REPLIES 2

Ayushi_Suthar
Honored Contributor
Honored Contributor

Hi @NhanNguyen , Hope you are doing well! 

Can you please confirm which cluster access mode you are using to run the above notebook command? 

As per the error details in the screenshot, I am assuming you are using catalog.clear_cache on the Shared Cluster mode and currently, the "catalog.clear_cache" feature does not support shared cluster mode and is only applicable for single-user mode or no isolation shared mode. This limitation is due to the current design of shared clusters in Databricks. 

So in case you are using the shared cluster mode, could you please try to run the commands on the Single User or no-isolation shared access mode?

Please let me know if this helps and leave a like if this information is useful, followups are appreciated.
Kudos
Ayushi

NhanNguyen
Contributor II

Thanks for your feedback, actually my cluster is shared cluster, and then I change to single cluster then can run that method/

Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!