โ10-30-2024 09:02 PM
How to edit the bucket path for the Unity Catalog metastore when it is set up later
Registered on 2024/10 from AWS marketplace.
We have created a customer management VPC and manually created the workspace.
I create S3 for metastore storage from workspace external location creation and set S3 path from account console.
Is there any way to change the bucket path and associated credentials?
Here is what we have tried
I could not edit the bucket from an external location.
I was able to modify another IAM role credentials, though,
The metastore screen of the account console did not reflect the changed IAM role.
โ10-31-2024 07:19 AM
Hi @tyorisoo ,
To edit the bucket path for the Unity Catalog metastore, follow these steps:
Prerequisites:
Update the S3 Path:
Modify IAM Role Credentials:
Update Metastore Configuration:
โ10-31-2024 05:39 PM
Thank you.
What I was trying to explain is that, like this document(https://docs.databricks.com/ja/data-governance/unity-catalog/create-metastore.html)
External location (created manually), register your credentials and
after creating the S3 bucket from the account console,
I wanted to know how to edit it after creating the S3 bucket from the account console.
Can I edit the following after setting up as attached?
ใปchange the bucket path
ใปCan the edited contents be reflected in the same IAM role?
ใปChange to a newly created IAM role
Here is what we have tried
ใปI could not edit the bucket from an external location.
ใปI was able to modify another IAM role credentials, though,
ใปThe metastore screen of the account console did not reflect the changed IAM role.
โ11-05-2024 04:55 PM
@NandiniN
Sorry, I hope you are seeing this reply.
โ11-05-2024 08:40 PM
Sorry @tyorisoo , I was not able to change the bucket. I will ask on of my team mates to review this and update here. Thanks!
โ11-05-2024 08:48 PM
Is it however possible for you to create a new external location with the desired bucket path.
And for the metadata update - You should be able to modify the IAM role credentials https://docs.databricks.com/en/connect/unity-catalog/storage-credentials.html#step-3-update-the-iam-... as long as you have the sufficient permissions. Ideally changes should be reflected immediately, but it also could be a cache issue hence try to refresh/re-save the changes and review the logs.
โ11-05-2024 09:07 PM
So @tyorisoo , I was able to check with one of my team mates. Only if you are an owner of the location, it can be edited, otherwise you ll have a to create a new one as I suggested earlier - create a new external location with the desired bucket path.
โ11-06-2024 04:09 PM
@NandiniN
Thanks for the reply.
I was able to check with one of my team mates. Only if you are an owner of the location, it can be edited, otherwise you ll have a to create a new one as I suggested earlier
I also created the external location.
Am I correct in that I can edit the path to an already created external location for the unitycatalog metastore?
What I want to know is on the account console screen of the captcha.
Metastore Settings.
How do I edit an already created external location for the unitycatalog metastore to change its path and role?
a month ago
Can you please try this -
-- Update the external location path
ALTER EXTERNAL LOCATION my_external_location
SET URL 's3://new-bucket/new-path';
-- Update the storage credential role
ALTER STORAGE CREDENTIAL my_storage_credential
SET IAM_ROLE 'arn:aws:iam::123456789012:role/new-role';
a month ago
Okay on carefully reviewing your image, doc and my internal repro
> You cannot modify this path once you set it.
Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโt want to miss the chance to attend and share knowledge.
If there isnโt a group near you, start one and help create a community that brings people together.
Request a New Group