- 64509 Views
- 20 replies
- 20 kudos
Resolved! Cannot use RDD and cannot set "spark.databricks.pyspark.enablePy4JSecurity false" for cluster
I have been using "rdd.flatMap(lambda x:x)" for a while to create lists from columns however after I have changed the cluster to a Shared acess mode (to use unity catalog) I get the following error: py4j.security.Py4JSecurityException: Method public ...
- 64509 Views
- 20 replies
- 20 kudos
- 20 kudos
Hi All,I faced the same issue. When i updated the cluster to DBR 15.5 it got resolved, it is not working in DBR 13.3 (my previous cluster version).Well, it is also working in DBR 10.4. I stayed with 15.5 as being the latest. Just try out with differe...
- 20 kudos
- 5749 Views
- 4 replies
- 3 kudos
Recommended Access mode for multiple users with R code functionality?
Hello,I recently tried running R code in a notebook. The notebook is about a year old and was used in a different cluster that no longer exists. I received the message, 'Your administrator has only allowed sql and python commands on this cluster. Thi...
- 5749 Views
- 4 replies
- 3 kudos
- 3 kudos
There's a feature in preview available that allows configuring single user access mode clusters that support R, where the assigned single user is a service principal. You can bind multiple users to the service principal to achieve multiple user acces...
- 3 kudos
- 17024 Views
- 12 replies
- 4 kudos
Problems with Unity Catalog
Hello.I am using Azure Databricks since a few months and I want to add a Unity Catalog.Unfortunately, I have some problems:1. I am not able to create a Unity Catalog Cluster with settings:- Policy: Unrestricted- Multi Node with Single user access mod...
- 17024 Views
- 12 replies
- 4 kudos
- 4 kudos
I'm facing the same issues as other customers listed above. I do not have the "Create Metastore" button available.
- 4 kudos