Facing mount/unmount issue while running same job parallelly with scala.

[rahul3]

 

Using above configuration in cluster, when I run databricks job parallelly with multiple request at a same time, then I am getting mount/unmount issue.

For an example : When I make three request to databricks job , it run 3 jobs parallelly but sometimes 3 of the jobs run successfully or sometimes 2 completes successfully and 1 gives out an error. Please suggest any workaround for this.

RemoteException: java.lang.IllegalArgumentException: requirement failed: Directory not mounted: /mnt/rahul; nested exception is: java.lang.IllegalArgumentException: requirement failed: Directory not mounted: /mnt/rahul Caused by: IllegalArgumentException: requirement failed: Directory not mounted: /mnt/rahul

[Prabakar]

hi @rahul upadhyay​ are you using the same mount path /mnt/rahul in all the 3 jobs? Could you please add the full error message?