topic Re: Uninstall whl file from databricks cluster via CLI in Machine Learning

Uninstall whl file from databricks cluster via CLI

Visakh_Vijayan — Thu, 12 Sep 2024 18:03:57 GMT

Hello, we have a need to uninstall older versions of whl files from personal cluster via databricks CLI - could you please provide the exact command to be used here. We tried with many found on the documentations but none of them worked to do the actual uninstall. Please help here. Thanks !

Re: Uninstall whl file from databricks cluster via CLI

michael569gardn — Fri, 13 Sep 2024 05:35:30 GMT

This topic is a very nice Official Site
Thank you for sharing

Re: Uninstall whl file from databricks cluster via CLI

szymon_dybczak — Fri, 13 Sep 2024 08:48:45 GMT

Hi @Visakh_Vijayan ,

Did you try to use databricks libraries uninstall? It's exactly crafted for this purpose

databricks libraries uninstall --json YOUR_JSON_WITH_REQUEST_BODY

Also, when you uninstall a library from a cluster, the library is removed only when you restart the cluster. Until you restart the cluster, the status of the uninstalled library appears as Uninstall pending restart.

Re: Uninstall whl file from databricks cluster via CLI

Visakh_Vijayan — Fri, 13 Sep 2024 16:08:44 GMT

Thanks for the immediate response ! Yes, we tried with an inline JSON string and executed it and the command went through without any success or failure messages but didn't do anything. The whl file was still there in the cluster even after a restart so we had to mark this as failed. The older CLI had an uninstall all libraries method. Is that still supported ? If not could you please send across a command with an actual JSON string with a dummy whl file ? We will compare if there were any formatting issues on our end and was the reason the uninstall didn't happen. Btw, we are using databricks CLI 0.227.1

Re: Uninstall whl file from databricks cluster via CLI

szymon_dybczak — Mon, 16 Sep 2024 19:09:47 GMT

Hi @Visakh_Vijayan ,

Sorry for late response, I didn't notice your reply. So I prepared simple example. Here I installed whl file on a cluster using below command:

databricks libraries install --json `@libraries_to_install.json

The content of libraries_to_install.json file looks following:

{ "cluster_id": "your_cluster_id", "libraries": [ { "whl": "/Workspace/Users/path_to_your_wheel/my_package-0.1-py2.py3-none-any.whl" } ] }

As a result I have installed whl library on cluster:

Now, to uninstall library I used below command:

databricks libraries uninstall --json `@libraries_to_uninstall.json

The content of libraries_to_uninstall.json is following:

{ "cluster_id": "your_cluster_id", "libraries": [ { "whl": "/Workspace/Users/path_to_your_wheel/my_package-0.1-py2.py3-none-any.whl" } ] }

After cluster restarted, wheel library uninstalled successfully .

Edit: If you use powershell terminal use backtick to escape @ character `@libraries_to_uninstall.json

Re: Uninstall whl file from databricks cluster via CLI

Visakh_Vijayan — Tue, 17 Sep 2024 15:30:04 GMT

Thanks a bunch ! Yep, that worked like a charm - appreciate the detailing of the solution 🙂