topic Re: How to restart the kernel on my notebook in databricks? in Data Engineering

How to restart the kernel on my notebook in databricks?

Paddy_chu — Wed, 31 May 2023 15:22:36 GMT

while installing a python package on my databricks notebook, I kept getting a message saying that: "Note: you may need to restart the kernel using dbutils.library.restartPython() to use updated packages."

I've tried restarting my cluster, also detach and reattach my cluster but the Note message still pops up on my notebook, after I ran my code.

Anyone knows how to solve this issue?

Re: How to restart the kernel on my notebook in databricks?

Evan_MCK — Mon, 19 Jun 2023 15:59:14 GMT

dbutils.library.restartPython()

Just run this code in the notebook without restarting the cluster or using pip install again. Restarting the cluster erased what you just installed with pip and you are back to square one. Restarting python after the pip installs will leave the packages installed and just restart the python interpreter.

see this: https://stackoverflow.com/a/75333780/22103209

Re: How to restart the kernel on my notebook in databricks?

johnb1 — Thu, 26 Sep 2024 15:02:41 GMT

@Evan_MCK

Follow-up question:

When other notebooks run Python code on the same cluster, will those runs be aborted when dbutils.library.restartPython() is called?

Re: How to restart the kernel on my notebook in databricks?

Imalkov — Fri, 27 Sep 2024 13:16:05 GMT

no, it's related only to current spark session