- 11770 Views
- 6 replies
- 5 kudos
I am running a notebook on the Coursera platform.my configuration file, Classroom-Setup, looks like this:%python
spark.conf.set("com.databricks.training.module-name", "deep-learning")
spark.conf.set("com.databricks.training.expected-dbr", "6.4")
...
- 11770 Views
- 6 replies
- 5 kudos
Latest Reply
Hi @Maria Bruevich​ ,From the error description, it looks like the mlflow library is not present. You can use ML cluster as these type of cluster already have mlflow library. Please check the below document:https://docs.databricks.com/release-notes/r...
5 More Replies
- 20241 Views
- 5 replies
- 12 kudos
Hi all,I was reading the Repos documentation: https://docs.databricks.com/repos.html#migrate-from-run-commandsIt is explained that, one advantage of Repos is no longer necessary to use %run magic command to make funcions available in one notebook to ...
- 20241 Views
- 5 replies
- 12 kudos
Latest Reply
Thank you all for your help! I tried all that was suggested; but I finally realized it was my fault in first place:I was testing Files in Repos with a runtime < 8.4.I was trying to import a file from a DB Notebook instead of a static .py file.Upgradi...
4 More Replies
- 2394 Views
- 1 replies
- 1 kudos
When run sparkR.session()I faced below error:Spark package found in SPARK_HOME: /databricks/spark
Launching java with spark-submit command /databricks/spark/bin/spark-submit sparkr-shell /tmp/Rtmp5hnW8G/backend_porte9141208532d
Error: Could not f...
- 2394 Views
- 1 replies
- 1 kudos
Latest Reply
This is due to the when users run their R scripts on Rstudio, the R session is not shut down gracefully. Databricks is working on handle the R session better and removed the limit. As a workaround, you can create and run below init script to increase...
- 1465 Views
- 1 replies
- 1 kudos
Using %sh, I am able to run commands on the notebook and get output. How can i run a command on the executor and get the output. I want to avoid using the Spark API's
- 1465 Views
- 1 replies
- 1 kudos
Latest Reply
It's not possible to use %sh to run commands on the executor. The below code can be used to run commands on the executor and get the outputvar res=sc.runOnEachExecutor[String]({ () =>
import sys.process._
var cmd_Result=Seq("bash", "-c", "h...
- 855 Views
- 2 replies
- 0 kudos
All the commands get canceled. even 1+1 is failing, the cluster is completely unusable.
- 855 Views
- 2 replies
- 0 kudos
Latest Reply
More details on similar issues here: https://kb.databricks.com/python/python-command-cancelled.html
1 More Replies
- 750 Views
- 1 replies
- 0 kudos
when I start the experiment with mlflow.start_run(),even if my script is interrupted or failed before executing mlflow.end_run() ,the run gets tagged as finished instead of unfinished , Can any one help why it is happening here
- 750 Views
- 1 replies
- 0 kudos
Latest Reply
In note book the mlflow tagas ias the command travels and once failed or exit there itself it logs and finishes the experiment even if the noteboolsfails. However, if you want to continue logging metrics or artifacts to that run, you just need to use...
