Using above configuration in cluster, when I run databricks job parallelly with multiple request at a same time, then I am getting mount/unmount issue.
For an example : When I make three request to databricks job , it run 3 jobs parallelly but sometimes 3 of the jobs run successfully or sometimes 2 completes successfully and 1 gives out an error. Please suggest any workaround for this.
RemoteException: java.lang.IllegalArgumentException: requirement failed: Directory not mounted: /mnt/rahul; nested exception is: java.lang.IllegalArgumentException: requirement failed: Directory not mounted: /mnt/rahul Caused by: IllegalArgumentException: requirement failed: Directory not mounted: /mnt/rahul
