StringIndexer method fails with shared compute

sandeephenkel23
New Contributor III

Dear Team

StringIndexer method of mlflow library upon running code on No Isolation Shared access mode data bricks cluster it works but it is failing on Unity catalog enabled data bricks cluster having Shared access mode.

here is the library name: from pyspark.ml.feature import StringIndexer.

Error is py4j.security. Py4JSecurityException: Constructor public org.apache.spark.ml.feature.StringIndexer(java.lang.String) is not whitelisted.