py4j.security.Py4JSecurityException: Constructor public com.databricks.backend.daemon.dbutils.FSUtilsParallel(org.apache.spark.SparkContext) is not whitelisted. - DBR 10.4 LTS Shared mode

parthsalvi
Contributor

‎09-19-2022 03:44 AM

We're trying to update permission in Unity Catalog using spark sql statetment spark.sql("ALTER TABLE %s.%s OWNER TO `%s`;" % (raw_schema, table_name, 'Metastore_Admins'))

But we're running into following error

image.png 

We're facing issues like these in DBR 10.4 Shared mode only for other methods as well.

Labels:
Preview file
97 KB