topic Re: How to access root mountPoint without "Access Denied"? in Data Engineering

How to access root mountPoint without "Access Denied"?

Dusko — Thu, 03 Feb 2022 16:43:11 GMT

Hi, I’m trying to read file from S3 root bucket. I can ls all the files but I can’t read it because of access denied. When I mount the same S3 root bucket under some other mountPoint, I can touch and read all the files. I also see that this new mountPoint have an empty encryptionType while others (including root) have sse-s3.

Maybe this could be the issue (we are trying access data through instance profiles)? My goal is to make root mountPoint "/" accessible because of all our hardcoded paths in dependencies and modules. We already checked all IAM roles, instance_profiles, bucket policies but without any luck.

Additional info:

Files I want to read are uploaded manually through AWS console
When I import .zip file as .whl library and %sh unzip that file I can read this file without any problem

Is there something we are missing? Thank you for your help!

Re: How to access root mountPoint without "Access Denied"?

Anonymous — Thu, 03 Feb 2022 17:26:36 GMT

Hi @Dušan Vystrcil. My name is Piper, and I'm one of the moderators here in the community. Thanks for your question and it's great to meet you. 🙂

We will give the community a chance to respond and then we will come back around if we need to.

Re: How to access root mountPoint without "Access Denied"?

Atanu — Sat, 12 Feb 2022 16:33:56 GMT

As databricks has the ownership of rootbucket I think manually upload from console will not work.For your second point - ( import .zip file as .whl library and %sh unzip ) I hope you are doing this through notebook so it will not giving you any issue.

Re: How to access root mountPoint without "Access Denied"?

Anonymous — Wed, 16 Feb 2022 16:56:40 GMT

@Dušan Vystrcil - Checking in. Does Atanu's answer help you?

Re: How to access root mountPoint without "Access Denied"?

Dusko — Thu, 17 Feb 2022 08:05:31 GMT

Hi @Atanu Sarkar , @Piper Wilson ,

thanks for the replies. Well I don't understand the fact about ownership. I believe that rootbucket is still under my ownership (I created it and I could upload/delete any files through browser without any problem). I can even list those files from notebook but can't read them.

I discovered that if I upload those files through databricks cli, I could read them. So maybe you're right about the "ownership" but I can't find any docs regarding this, so I could understand it. Do we have anything?

Re: How to access root mountPoint without "Access Denied"?

jose_gonzalez — Tue, 22 Mar 2022 16:41:09 GMT

Hi @Dušan Vystrcil ,

Just a friendly follow-up. Did you have time to check the docs @Kaniz Fatma shared? did it help to resolve your issue or not? please let us know.

Re: How to access root mountPoint without "Access Denied"?

Dusko — Tue, 22 Mar 2022 17:18:08 GMT

Yeah Jose, that was exactly I was looking for! Thanks @Kaniz Fatma