Issue while reading data from Kafka topic to Spark strutured streaming

ramravi
Contributor II

py4j.security.Py4JSecurityException: Method public org.apache.spark.sql.streaming.DataStreamReader org.apache.spark.sql.SQLContext.readStream() is not whitelisted on class class org.apache.spark.sql.SQLContext

I already disable acl for cluster using

"spark.databricks.acl.dfAclsEnabled":true at cluster configuration.

Also Table access control disables for workspace.

I followed this link but not helping

https://kb.databricks.com/streaming/readstream-is-not-whitelisted.html