Issue while reading data from Kafka topic to Spark strutured streaming
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-03-2023 01:19 AM
py4j.security.Py4JSecurityException: Method public org.apache.spark.sql.streaming.DataStreamReader org.apache.spark.sql.SQLContext.readStream() is not whitelisted on class class org.apache.spark.sql.SQLContext
I already disable acl for cluster using
"spark.databricks.acl.dfAclsEnabled":true at cluster configuration.
Also Table access control disables for workspace.
I followed this link but not helping
https://kb.databricks.com/streaming/readstream-is-not-whitelisted.html
- Labels:
-
Class Class
-
Kafka
-
Kafka Topic
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-03-2023 01:24 AM
Don't you have some policies set by the administrator?
Additionally, when starting the cluster, please choose "Access mode" = "Single user".
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
01-03-2023 09:57 AM
Hi, Streaming is not supported in credentials passthrough, table ACLS or HC clusters, which is not the case here as you mentioned those options are already disabled. Could you please crosscheck and raise a support case with Databricks if everything looks fine from your end?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-06-2023 11:27 AM
Hi @Ravi Teja,
Just a friendly follow-up. Do you still need help? if you do, please share more details, like DBR version, standard or High concurrency cluster? etc

