Error while running spark.catalog.listDatabases()
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-11-2023 01:13 PM
I am running steps mentioned in https://github.com/databrickslabs/splunk-integration/blob/master/notebooks/source/push_to_splunk.py
When I am running
spark.catalog.listDatabases()
getting error
py4j.security.Py4JSecurityException: Method public java.lang.String org.apache.spark.sql.catalog.Database.name() is not whitelisted on class class org.apache.spark.sql.catalog.Database
- Labels:
-
Azure databricks
-
Spark
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-13-2023 05:37 AM
Hi @Purnima Bhatia , I faced a similar error for a different command when I was using a wrong type of cluster access mode. You can try to create a different cluster with different access mode and check. I might be wrong but try and check this.

