Unable to run python script from Azure DevOps git repo in Databricks Workflow job

SakthiGanesh
New Contributor II

Hi, I'm getting an issue while running a python script from Azure DevOps git repo in Databricks Workflow job task. The error stating internal commit path issue. But I referred the Source as Azure DevOps Services and I gave the branch name when setting up the task. Also, the latest file is available in repos branch. I checked the driver logs and there is no error statement. Please find the below error statement.

Any idea on this?

Run failed with error message Cannot read the python file /Repos/.internal/277bc54e62_commits/c422b52459f3ca31841c384b04b0635ceb9567d7/filename.py. Please check driver logs for more details.

niteshm
New Contributor III

@SakthiGanesh 
This is a known type of issue when running Databricks Workflows with Azure DevOps Git-backed repos.
Did you try, Workspace Path Instead of Internal Git Path?

If possible, use a .ipynb notebook-based task rather than a raw .py script, notebooks handle Git linkage more gracefully in Databricks Workflows.