Latest pushed code is not taken into account by Notebook

pgagliardi — Thu, 08 Dec 2022 19:14:40 GMT

Hello,

I cloned a repo my_repo in the Dataricks space Repos.

Inside my_repo, I created a notebook new_experiment where I can import functions from my_repo, which is really handy.

When I want to modify a function in my_repo, I open my local IDE, do the modifications and push them on Github, then I pull the changes on Databricks. The problem is that when I import the function in new_experiment the changes are not synchronized.

I tried :

%load_ext autoreload %autoreload 2

But the only solution seems to detach & reattach the cluster, which is a pain as I have to rerun the code from scratch. Is there a better solution?

Re: Latest pushed code is not taken into account by Notebook

Jnguyen — Thu, 08 Feb 2024 06:39:02 GMT

Use

%reload_ext autoreload

instead, it will do your expected behavior.
You just need to run it once, like %load_ext autoreload %autoreload 2

topic Latest pushed code is not taken into account by Notebook in Data Engineering

Latest pushed code is not taken into account by Notebook

Re: Latest pushed code is not taken into account by Notebook