topic Re: Invalid Path when getting Notebook Path in Data Engineering

Invalid Path when getting Notebook Path

Steve_Harrison — Fri, 30 Aug 2024 10:17:22 GMT

The undocumented feature to get a notebook path as is great but it does not actually return a valid path that can be used in python, e.g.:

from pathlib import Path

print(Path(dbutils.notebook.entry_point.getDbutils().notebook().getContext().notebookPath().get()).exists())

Always returns False. Is there a method of getting the actual path of a notebook?

The above suffers from two problems:

It appears to strip off the /Workspace from the start of the path
It removes the suffix from the path

2 is not so much of an issue but the first one is a royal pain.

Re: Invalid Path when getting Notebook Path

Walter_C — Wed, 11 Dec 2024 11:49:51 GMT

The issue you're encountering with dbutils.notebook.entry_point.getDbutils().notebook().getContext().notebookPath().get() not returning a valid path that can be used in Python is known. This method indeed strips off the /Workspace from the start of the path and removes the suffix, which causes the Path.exists() check to fail.

To get the actual path of a notebook, you can prepend /Workspace to the path returned by getDbutils().notebook().getContext().notebookPath().get(). Here is an example of how you can modify your code to achieve this:

from pathlib import Path import os # Get the notebook path notebook_path = dbutils.notebook.entry_point.getDbutils().notebook().getContext().notebookPath().get() # Prepend '/Workspace' to the path full_notebook_path = '/Workspace' + notebook_path # Check if the path exists print(Path(full_notebook_path).exists())

Re: Invalid Path when getting Notebook Path

Steve_Harrison — Wed, 11 Dec 2024 13:02:26 GMT

I actually think the major issue is that the above is undocumented and not supported. A supported and documented way of doing this would be much appreciated.