โ09-15-2022 07:56 AM
I am not sure if I am missing something, but I just created External Table using External Location and I can still access both data through the table and directly access files from the storage:
documentation:https://docs.databricks.com/data-governance/unity-catalog/create-tables.html#create-an-external-tabl...
โ10-07-2022 12:44 AM
I got the answer from the Databricks Support on this.
The point which has been mentioned in doc "Once a table is created in a path, users can no longer directly access the files in that path even if they have been given privileges on an external location or storage credential to do so. This is to ensure that users cannot circumvent access controls applied to tables by reading files from your cloud tenant directly." is a bit different. Consider there is User U4 who is having access to the external location but DO NOT have access to the table T1. In such a scenario the aforementioned point is applicable and we raise an error like โPERMISSION_DENIED: trying to access path with conflicting external tablesโ.
โ09-15-2022 11:30 AM
@Pat Sienkiewiczโ : Have you tried to do select on the table with another user other than the owner who has permission to storage location?
โ09-15-2022 11:41 PM
I am using terraform to create storage credentials and external locations and the owner is not my user.
Still, I would expect as per documentation that even owner should not be able to access data via file path if table was created. I believe that I tested this before and worked, so not why this is happening now. Looks like bug to me.
โ09-28-2022 01:05 AM
Hi @Pat Sienkiewiczโ
Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.
We'd love to hear from you.
Thanks!
โ10-07-2022 12:44 AM
I got the answer from the Databricks Support on this.
The point which has been mentioned in doc "Once a table is created in a path, users can no longer directly access the files in that path even if they have been given privileges on an external location or storage credential to do so. This is to ensure that users cannot circumvent access controls applied to tables by reading files from your cloud tenant directly." is a bit different. Consider there is User U4 who is having access to the external location but DO NOT have access to the table T1. In such a scenario the aforementioned point is applicable and we raise an error like โPERMISSION_DENIED: trying to access path with conflicting external tablesโ.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group