topic Re: py4j.security.Py4JSecurityException: Constructor public com.databricks.backend.daemon.dbutils.FSUtilsParallel(org.apache.spark.SparkContext) is not whitelisted. - DBR 10.4 LTS Shared mode in Machine Learning

py4j.security.Py4JSecurityException: Constructor public com.databricks.backend.daemon.dbutils.FSUtilsParallel(org.apache.spark.SparkContext) is not whitelisted. - DBR 10.4 LTS Shared mode

parthsalvi — Mon, 19 Sep 2022 10:44:46 GMT

We're trying to update permission in Unity Catalog using spark sql statetment spark.sql("ALTER TABLE %s.%s OWNER TO `%s`;" % (raw_schema, table_name, 'Metastore_Admins'))

But we're running into following error

We're facing issues like these in DBR 10.4 Shared mode only for other methods as well.

Re: py4j.security.Py4JSecurityException: Constructor public com.databricks.backend.daemon.dbutils.FSUtilsParallel(org.apache.spark.SparkContext) is not whitelisted. - DBR 10.4 LTS Shared mode

Aviral-Bhardwaj — Sun, 18 Dec 2022 07:19:38 GMT

I have seen this before

so there is one file in the DBFS where we have to write the whitelisted file , so you have to find out where is your whitelisted file location after that you have to add that "com.databricks.....parallel" line in that file and upload it to in the dbfs using dbutils.put command after that it will work.

means any how you have to whitelist above sting that you can see in the error logs

Let me know if it works fr you

Thanks

Aviral Bhardwaj