Enable custom Ipython Extension

[Soma]

How to enable custom Ipython Extension on Databricks Notebook Start

[Hubert-Dudek]

Some extension can be just install via pip. In such a case it can be added permanently to cluster (in compute -> select your cluster -> library tab) or installed via notebooks (with magic %pip install your_library command or alternatively %conda).

[Soma]

I want to load custom extensions which I create

like custom call back events on cell run

https://ipython.readthedocs.io/en/stable/config/callbacks.html

[Hubert-Dudek · Accepted solution]

For sure you need to try to change kernel to ipython as described here https://docs.microsoft.com/en-us/azure/databricks/notebooks/ipython-kernel by adding following spark config value in cluster settings:

spark.databricks.python.defaultPythonRepl ipykernel