11-14-2022 01:22 PM
In setting up Databricks accounnt, we need to provide storage (s3 buckets) to store the final cleaned data or aggregated data. If the Unity Catalog is enabled at the beginning of account set up, we'd need to to provide S3 buckets again to store the metedata. My question: can it be one S3 bucket for final cleaned data and the Unity Catalog, or do they need to be separate s3 buckets?
11-15-2022 07:27 AM
HI @Tram Nguyen ,
I am not sure if I got this correctly but I believe you are referring to the:
It's not recommended to re-use the workspace s3 bucket for metastore.
thanks,
Pat.
11-15-2022 10:22 AM
@Tram Nguyen above pat provided links will have clear information. but to provide overview
unity catalog bucket should be configured in same region of your account, so that no network Issues will be seen. multiple workspaces in that account can use same unity catalog metastore (which is s3 bucket)
11-21-2022 04:20 PM
Hi @Tram Nguyen, We haven’t heard from you since the last response from @Pat Sienkiewicz and @karthik p, and I was checking back to see if their suggestions helped you.
Or else, If you have any solution, please share it with the community, as it can be helpful to others.
Also, Please don't forget to click on the "Select As Best" button whenever the information provided helps resolve your question.
Join our fast-growing data practitioner and expert community of 80K+ members, ready to discover, help and collaborate together while making meaningful connections.
Click here to register and join today!
Engage in exciting technical discussions, join a group with your peers and meet our Featured Members.