- 55886 Views
- 17 replies
- 17 kudos
Resolved! Cannot use RDD and cannot set "spark.databricks.pyspark.enablePy4JSecurity false" for cluster
I have been using "rdd.flatMap(lambda x:x)" for a while to create lists from columns however after I have changed the cluster to a Shared acess mode (to use unity catalog) I get the following error: py4j.security.Py4JSecurityException: Method public ...
- 55886 Views
- 17 replies
- 17 kudos
- 17 kudos
In my case the problem was that we were trying to use SparkXGBoostRegressor and in the docs it says that it does not work on clusters with autoscaling enabled. So we just disabled autoscaling for the interactive cluster where we were testing the mode...
- 17 kudos
- 4645 Views
- 5 replies
- 3 kudos
Recommended Access mode for multiple users with R code functionality?
Hello,I recently tried running R code in a notebook. The notebook is about a year old and was used in a different cluster that no longer exists. I received the message, 'Your administrator has only allowed sql and python commands on this cluster. Thi...
- 4645 Views
- 5 replies
- 3 kudos
- 3 kudos
There's a feature in preview available that allows configuring single user access mode clusters that support R, where the assigned single user is a service principal. You can bind multiple users to the service principal to achieve multiple user acces...
- 3 kudos
- 13607 Views
- 13 replies
- 4 kudos
Problems with Unity Catalog
Hello.I am using Azure Databricks since a few months and I want to add a Unity Catalog.Unfortunately, I have some problems:1. I am not able to create a Unity Catalog Cluster with settings:- Policy: Unrestricted- Multi Node with Single user access mod...
- 13607 Views
- 13 replies
- 4 kudos
- 4 kudos
I'm facing the same issues as other customers listed above. I do not have the "Create Metastore" button available.
- 4 kudos