Your administrator has forbidden Scala UDFs from being run on this cluster. How to enable access to Scala UDF on Azure Databricks cluster ?

Pawan1 — Thu, 25 Aug 2022 10:38:34 GMT

Hi All,

When i try to run a scala UDF in Azuredatabricks 10.1 (includes Apache Spark 3.2.0, Scala 2.12) cluster i was able to run the udf. However when i tried to run the same notebook in 10.4 LTS (includes Apache Spark 3.2.1, Scala 2.12) cluster i have been thrown with this error.

SecurityException: Your administrator has forbidden Scala UDFs from being run on this cluster

at com.databricks.sql.acl.CheckPermissions.exprNodeToRequests(CheckPermissions.scala:1144)

at com.databricks.sql.acl.HiveCheckPermissions.exprNodeToRequests(HiveCheckPermissions.scala:79)

at com.databricks.sql.acl.CheckPermissions.toRequests(CheckPermissions.scala:309)

at com.databricks.sql.acl.CheckPermissions.$anonfun$toRequests$1(CheckPermissions.scala:309)

at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:293)

at scala.collection.Iterator.foreach(Iterator.scala:943)

Is there any configuration i have to enable in order make the scala udf run ? .

Thanks in advance for the help.

Re: Your administrator has forbidden Scala UDFs from being run on this cluster. How to enable access to Scala UDF on Azure Databricks cluster ?

Debayan — Mon, 24 Apr 2023 15:07:40 GMT

Hi, Are you trying this with High concurrency clusters?

Also, please tag @Debayan Mukherjee with your next response so that I will get notified.

topic Re: Your administrator has forbidden Scala UDFs from being run on this cluster. How to enable access to Scala UDF on Azure Databricks cluster ? in Data Engineering

Your administrator has forbidden Scala UDFs from being run on this cluster. How to enable access to Scala UDF on Azure Databricks cluster ?

Re: Your administrator has forbidden Scala UDFs from being run on this cluster. How to enable access to Scala UDF on Azure Databricks cluster ?