cancel
Showing results for 
Search instead for 
Did you mean: 
Data Engineering
Join discussions on data engineering best practices, architectures, and optimization strategies within the Databricks Community. Exchange insights and solutions with fellow data engineers.
cancel
Showing results for 
Search instead for 
Did you mean: 

Enable custom Ipython Extension

Soma
Valued Contributor

How to enable custom Ipython Extension on Databricks Notebook Start

1 ACCEPTED SOLUTION

Accepted Solutions

Hubert-Dudek
Esteemed Contributor III

For sure you need to try to change kernel to ipython as described here https://docs.microsoft.com/en-us/azure/databricks/notebooks/ipython-kernel by adding following spark config value in cluster settings:

spark.databricks.python.defaultPythonRepl ipykernel

View solution in original post

3 REPLIES 3

Hubert-Dudek
Esteemed Contributor III

Some extension can be just install via pip. In such a case it can be added permanently to cluster (in compute -> select your cluster -> library tab) or installed via notebooks (with magic %pip install your_library command or alternatively %conda).

Soma
Valued Contributor

I want to load custom extensions which I create

like custom call back events on cell run

https://ipython.readthedocs.io/en/stable/config/callbacks.html

Hubert-Dudek
Esteemed Contributor III

For sure you need to try to change kernel to ipython as described here https://docs.microsoft.com/en-us/azure/databricks/notebooks/ipython-kernel by adding following spark config value in cluster settings:

spark.databricks.python.defaultPythonRepl ipykernel

Join Us as a Local Community Builder!

Passionate about hosting events and connecting people? Help us grow a vibrant local community—sign up today to get started!

Sign Up Now