Enable custom Ipython Extension

Soma
Valued Contributor

How to enable custom Ipython Extension on Databricks Notebook Start

Hubert-Dudek
Databricks MVP

Some extension can be just install via pip. In such a case it can be added permanently to cluster (in compute -> select your cluster -> library tab) or installed via notebooks (with magic %pip install your_library command or alternatively %conda).


My blog: https://databrickster.medium.com/

Soma
Valued Contributor

I want to load custom extensions which I create

like custom call back events on cell run

https://ipython.readthedocs.io/en/stable/config/callbacks.html

For sure you need to try to change kernel to ipython as described here https://docs.microsoft.com/en-us/azure/databricks/notebooks/ipython-kernel by adding following spark config value in cluster settings:

spark.databricks.python.defaultPythonRepl ipykernel


My blog: https://databrickster.medium.com/

View solution in original post