Databricks Community

priyak · 03-16-2023

Using the install_libraries API, I installed a custom Python whl file on a running cluster. For certain types of requests, we have a requirement to install a different version of the same custom whl file in the running cluster. My problem is that uni...

priyak · 04-06-2023

@Suteja Kanuri Thanks for your suggestions. Please combine both your responses, I will mark that as the best answer.

priyak · 04-05-2023

@Suteja Kanuri Any thoughts on the above question?

priyak · 03-27-2023

Thank you for the response. Are there any ways to mitigate the risks of options 2 and 3? Is it possible to check whether the existing tasks are completed and the cluster is an idle state before we attempt to reload the module/restart the interpreter?

Databricks Community

User Stats

User Activity

Multiple versions of custom libraries on the cluster

Re: Multiple versions of custom libraries on the cluster

Re: Multiple versions of custom libraries on the cluster

Re: Multiple versions of custom libraries on the cluster