cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
cancel
Showing results for 
Search instead for 
Did you mean: 

Enable custom Ipython Extension

Soma
Valued Contributor

How to enable custom Ipython Extension on Databricks Notebook Start

1 ACCEPTED SOLUTION

Accepted Solutions

Hubert-Dudek
Esteemed Contributor III

For sure you need to try to change kernel to ipython as described here https://docs.microsoft.com/en-us/azure/databricks/notebooks/ipython-kernel by adding following spark config value in cluster settings:

spark.databricks.python.defaultPythonRepl ipykernel

View solution in original post

4 REPLIES 4

Hubert-Dudek
Esteemed Contributor III

Some extension can be just install via pip. In such a case it can be added permanently to cluster (in compute -> select your cluster -> library tab) or installed via notebooks (with magic %pip install your_library command or alternatively %conda).

Soma
Valued Contributor

I want to load custom extensions which I create

like custom call back events on cell run

https://ipython.readthedocs.io/en/stable/config/callbacks.html

Hubert-Dudek
Esteemed Contributor III

For sure you need to try to change kernel to ipython as described here https://docs.microsoft.com/en-us/azure/databricks/notebooks/ipython-kernel by adding following spark config value in cluster settings:

spark.databricks.python.defaultPythonRepl ipykernel

Kaniz
Community Manager
Community Manager

Hi @somanath Sankaran​ , Did you try to change kernel to ipython as suggested by @Hubert Dudek​ ?

Welcome to Databricks Community: Lets learn, network and celebrate together

Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections. 

Click here to register and join today! 

Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.