cancel
Showing results for 
Search instead for 
Did you mean: 
Machine Learning
Dive into the world of machine learning on the Databricks platform. Explore discussions on algorithms, model training, deployment, and more. Connect with ML enthusiasts and experts.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

parthsalvi
by Contributor
  • 2401 Views
  • 1 replies
  • 2 kudos

py4j.security.Py4JSecurityException: Constructor public com.databricks.backend.daemon.dbutils.FSUtilsParallel(org.apache.spark.SparkContext) is not whitelisted. - DBR 10.4 LTS Shared mode

We're trying to update permission in Unity Catalog using spark sql statetment spark.sql("ALTER TABLE %s.%s OWNER TO `%s`;" % (raw_schema, table_name, 'Metastore_Admins'))But we're running into following error We're facing issues like these in DBR 10....

image.png
  • 2401 Views
  • 1 replies
  • 2 kudos
Latest Reply
Aviral-Bhardwaj
Esteemed Contributor III
  • 2 kudos

I have seen this beforeso there is one file in the DBFS where we have to write the whitelisted file , so you have to find out where is your whitelisted file location after that you have to add that "com.databricks.....parallel" line in that file and ...

  • 2 kudos
cheng
by New Contributor
  • 681 Views
  • 0 replies
  • 0 kudos

Prophet/PyStan compiling error in Runtime 10.4 LTS ML

We're upgrading our ML jobs from using Runtime 9.1 LTS ML to Runtime 10.4 LTS ML in Databricks. One of the libraries our jobs relying on is Prophet. From 9.1 to 10.4, both the versions of Prophet (1.0.1) and PyStan (2.19.1.1) haven't changed, however...

  • 681 Views
  • 0 replies
  • 0 kudos
confusedIntern
by New Contributor III
  • 2104 Views
  • 4 replies
  • 0 kudos

Resolved! Spark Version Json code for LTS ML cluster

Hi! Any help will be greatly appreciated! Thank you so much! So I'm currently following this tutorial: https://docs.databricks.com/applications/mlflow/projects.htmlIn the tutorial, for the cluster specification, it has "spark_version": "7.3.x-scala2....

  • 2104 Views
  • 4 replies
  • 0 kudos
Latest Reply
tomasz
New Contributor III
  • 0 kudos

Also for 9.1 LTS ML it should be: "9.1.x-cpu-ml-scala2.12"

  • 0 kudos
3 More Replies
Labels