- 61839 Views
- 19 replies
- 20 kudos
Resolved! Cannot use RDD and cannot set "spark.databricks.pyspark.enablePy4JSecurity false" for cluster
I have been using "rdd.flatMap(lambda x:x)" for a while to create lists from columns however after I have changed the cluster to a Shared acess mode (to use unity catalog) I get the following error: py4j.security.Py4JSecurityException: Method public ...
- 61839 Views
- 19 replies
- 20 kudos
- 20 kudos
Hello,In the past I used rdd.mapPartitions(lambda ...) to call functions that access third party APIs like azure ai translate text to batch call the API and return the batched data.How would one do this now?
- 20 kudos
- 5537 Views
- 4 replies
- 3 kudos
Recommended Access mode for multiple users with R code functionality?
Hello,I recently tried running R code in a notebook. The notebook is about a year old and was used in a different cluster that no longer exists. I received the message, 'Your administrator has only allowed sql and python commands on this cluster. Thi...
- 5537 Views
- 4 replies
- 3 kudos
- 3 kudos
There's a feature in preview available that allows configuring single user access mode clusters that support R, where the assigned single user is a service principal. You can bind multiple users to the service principal to achieve multiple user acces...
- 3 kudos
- 16059 Views
- 12 replies
- 4 kudos
Problems with Unity Catalog
Hello.I am using Azure Databricks since a few months and I want to add a Unity Catalog.Unfortunately, I have some problems:1. I am not able to create a Unity Catalog Cluster with settings:- Policy: Unrestricted- Multi Node with Single user access mod...
- 16059 Views
- 12 replies
- 4 kudos
- 4 kudos
I'm facing the same issues as other customers listed above. I do not have the "Create Metastore" button available.
- 4 kudos