Hi @Avi Edri​ ,

it looks like your users are missing SELECT ANY FILE permission (which admins are granted by default), please see here for more details:

https://docs.databricks.com/security/access-control/table-acls/object-privileges.html

I assume you are not using Unity Catalog. It's not easy to achieve both without Unity Catalog - access data through Tables and through file path (spark.read... ).

You might need to re-visit data access on your side. I do believe when you have Table Access Control enabled cluster then you are limited to use tables - select * from some_table, unless you have permission to SELECT ANY FILE, then you can bypass this restriction.

Unity Catalog is way forward, it enables more security and allows some flexibility here.

thanks,

Patryk.