cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Why can't I delete experiments without deleting the notebook? Or better Organize experiments into folders?

SparkMaster
New Contributor III

My Databricks Experiments is cluttered with a whole lot of experiments. Many of them are notebooks which are showing there for some reason (even though they didn't have an MLflow run associated with it). I would like to delete the experiments, but it gives the message "Note: This action will also delete the notebook that corresponds to this experiment.

Are you sure you want to delete [notebook_name]?" Why isn't there an option to delete the experiment without deleting the notebook? It makes no sense. Also, why can't we create folder structures to better organize the experiments?

11 REPLIES 11

Debayan
Databricks Employee
Databricks Employee

Hi, Did you create notebook experiments? https://docs.databricks.com/mlflow/experiments.html#create-notebook-experiment

Also, workspace experiments can be created: https://docs.databricks.com/mlflow/experiments.html#create-workspace-experiment

Please let us know if this helps. Also, please tag @Debayan​ with your next comment so I will be getting notified.

SparkMaster
New Contributor III

Hi, no, for some reason the notebooks I create on my workspace are automatically populating the experiments page; these notebooks have no experiments associated with them. Why is this? The experiments page gets cluttered with all these notebooks for no reason, and I can't simply delete these experiments because then the notebook is automatically deleted.

SparkMaster
New Contributor III

@Debayan Mukherjee​ , As you can see below, I create a blank notebook, and then it is automatically added to the Experiments page, even though nothing in it is related to MLflow. How can I prevent this? It is making my Experiments page very confusing to navigate. image.png

Anonymous
Not applicable

Hi @Seylan Naidoo​ 

We haven't heard from you since the last response from @Debayan Mukherjee​ ​, and I was checking back to see if her suggestions helped you.

Or else, If you have any solution, please share it with the community, as it can be helpful to others. 

Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.

Hi, unfortunately not. When I create and run a notebook on my workspace, they are getting added to the Experiments page even though they is nothing related to "MLflow on these notebooks.

@Anonymous , please remove my name from showing on this reply! Thanks. 

Debayan
Databricks Employee
Databricks Employee

Hi when you say creating notebooks ended up added in experiments page, do you mean if you create normal notebooks also it is getting added?

SparkMaster
New Contributor III

@Debayan Mukherjee​ Yes, please see the example image I showed above: if I go to my workspace, click the 3 dots on the right, then click Create and then select Notebook, this "normal" notebook is getting added to the experiments page.

Debayan
Databricks Employee
Databricks Employee

Hi, apologies for the delayed response. Was this issue resolved? 

mhiltner
Databricks Employee
Databricks Employee

Hey @Debayan @SparkMaster 

A bit late here, but I believe this is being caused by a click on the right side experiments icon. This may look like a meaningless click but it actually triggers a run. 

Hi @mhiltner 

You are correct, simply clicking the experiment icon on the right will create an experiment. Why is this the default behaviour? It's cluttering the workspace, creates unnecessary experiments just by creating new notebook, because if you do not close the experiments tab before closing the notebook, then it will auto-open on any notebook you open after. 

Please fix this, this is more than annoying, considering you can't delete the experiment without deleting the notebook.

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group