py4j.security.Py4JSecurityException: Constructor public com.databricks.backend.daemon.dbutils.FSUtilsParallel(org.apache.spark.SparkContext) is not whitelisted. - DBR 10.4 LTS Shared mode
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
09-19-2022 03:44 AM
We're trying to update permission in Unity Catalog using spark sql statetment spark.sql("ALTER TABLE %s.%s OWNER TO `%s`;" % (raw_schema, table_name, 'Metastore_Admins'))
But we're running into following error
We're facing issues like these in DBR 10.4 Shared mode only for other methods as well.
- Labels:
-
LTS
-
Public
-
Unity Catalog
-
Use
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
12-17-2022 11:19 PM
I have seen this before
so there is one file in the DBFS where we have to write the whitelisted file , so you have to find out where is your whitelisted file location after that you have to add that "com.databricks.....parallel" line in that file and upload it to in the dbfs using dbutils.put command after that it will work.
means any how you have to whitelist above sting that you can see in the error logs
Let me know if it works fr you
Thanks
Aviral Bhardwaj