Your administrator has forbidden Scala UDFs from being run on this cluster. How to enable access to Scala UDF on Azure Databricks cluster ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
08-25-2022 03:38 AM
Hi All,
When i try to run a scala UDF in Azuredatabricks 10.1 (includes Apache Spark 3.2.0, Scala 2.12) cluster i was able to run the udf. However when i tried to run the same notebook in 10.4 LTS (includes Apache Spark 3.2.1, Scala 2.12) cluster i have been thrown with this error.
SecurityException: Your administrator has forbidden Scala UDFs from being run on this cluster
at com.databricks.sql.acl.CheckPermissions.exprNodeToRequests(CheckPermissions.scala:1144)
at com.databricks.sql.acl.HiveCheckPermissions.exprNodeToRequests(HiveCheckPermissions.scala:79)
at com.databricks.sql.acl.CheckPermissions.toRequests(CheckPermissions.scala:309)
at com.databricks.sql.acl.CheckPermissions.$anonfun$toRequests$1(CheckPermissions.scala:309)
at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:293)
at scala.collection.Iterator.foreach(Iterator.scala:943)
Is there any configuration i have to enable in order make the scala udf run ? .
Thanks in advance for the help.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-24-2023 08:07 AM
Hi, Are you trying this with High concurrency clusters?
Also, please tag @Debayan Mukherjee with your next response so that I will get notified.