K_Anudeep
Databricks Employee
Databricks Employee

Hello @siva_pusarla ,

As per official docs, the “absolute path” examples for running/importing notebooks are like:

  • /Users/<user>@<org>/folder/notebook (workspace notebooks)
  • and for repos, /Repos/... or /Workspace/Repos/... (those two are equivalent for Repos)

So /Workspace/YourFolder/NotebookA is often not a valid notebook object path, unless that exact path exists as a notebook path in your workspace.

Also, when the job is configured to run from a remote Git repository, the notebook being executed is an ephemeral checkout, and paths behave differently between Git folders and workspace folders. Databricks even calls out that Git-folder path behaviour can differ from workspace-folder behaviour.

Please refer to dochttps://kb.databricks.com/libraries/paths-behave-differently-on-git-folders-and-workspace-folders

So in the job run, Databricks tries to resolve /Workspace/YourFolder/NotebookA as a notebook path and can’t find it and hence throws the pathNotFoundError

You need to refer to this doc for best practices to use Notebooks: https://docs.databricks.com/aws/en/notebooks/notebook-workflows

 

Anudeep