%run and Repos path error

indianaDE — Fri, 27 Sep 2024 18:11:38 GMT

We have one notebook(N1) which uses the %run command to call a second notebook(N2) which also calls a third notebook(N3) using %run. When running the %run cell within N2, N3 is successfully called and run. When running the %run cell within N1 we get the error below. These %run commands are using the relative paths ./ to call the subnotebooks (N2 and N3), so that the code is portable between branches:

Notebook not found: Workspace/Repos/user_folder/<DevOps Repository Name>/folder/NB3....

The %run is replacing the user defined name of the Repo, with the actual name of the DevOps repository. This is not the path to N3 which should have the user defined folder name within the path. All other methods to return the absolute path of the NBs (ls, dbutils, os etc. show the correct path).

Our environment recently received the update which moved the Repo folder under the Workspace folder, is there any chance there was an issue casued there?

Re: %run and Repos path error

Brahmareddy — Sat, 28 Sep 2024 03:46:50 GMT

Hi @indianaDE,

How are you doing today?

As per my understanding,

Consider checking the relative paths you’re using in the %run commands, as the recent update might have changed how Databricks resolves paths for notebooks under the new Workspace/Repos structure. Instead of relying on relative paths (./), try using absolute paths to ensure the correct notebooks are referenced. You could also explore using dbutils.notebook.run() for more flexibility in specifying paths. If the issue persists, review whether the Repo folder structure update could be interfering with path resolution, and verify that each path correctly aligns with the new folder hierarchy.

Give a try and let me know how it goes.

Good day!

Regards,

Brahma

topic Re: %run and Repos path error in Data Engineering

%run and Repos path error

Re: %run and Repos path error