Thanks for weighing in, I tested this piece, I am getting:

"Execution Error: An error occurred while calling o481.head

:org.apache.spark.security.exception : [INSUFFICIENT_PERMISSION] Insufficient previleges  

user does not have permission to select on any file SQLSTATE : 42501"

How do I fix this? Is it a policy issue for my credentials?

Thanks for your guidance.