I am having an issue where my permissions aren't being passed to workflows.
I can use the same cluster to access files in an S3 repo but if I try to do spark-submit or a jar task on workflows I am unable to reach my buckets. I am trying to use Unity Catalog rather than instance profiles.
Any help trying to diagnose this issue is also appreciated.
Thanks,
