Yes, Both are in the same workspace and querying same table
Yes the principle has all the access.
Also its working with spark python job, the problem is with spark submit job only.
My usecase is supported only in submit job since I am having multiple scripts in a zip file