Best practice for organizing data objects using Unity Catalog
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-17-2023 07:46 AM
I was wondering if there is a best practice or recommended way to organize data objects (tables) in Unity Catalog.
Following the medallion architecture, how should one organize and name these three namespaces:
- Catalog(s)
- Schema(s)
- Table(s)
Example:
- Catalog: environment specific (dev / test / prod)
- Schema: layer specific (bronze / silver / gold)
- Table: tablename (sourceX_employee)
Example2:
- Catalog: environment and source specific (dev_sourceX / test_sourceX / prod_sourceX)
- Schema: layer specific (bronze / silver / gold)
- Table: tablename (employee)
How are you organizing your tables?
- Labels:
-
Organize
-
Unity Catalog
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-22-2023 09:04 PM
Hi @Oscar Dyremyhr
Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help.
We'd love to hear from you.
Thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
02-23-2023 10:14 AM
HI @Oscar Dyremyhr ,
Just a friendly follow-up. Did any of the responses help you to resolve your question? if it did, please mark it as best. Otherwise, please let us know if you still need help.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
03-24-2023 07:24 AM
In Real time do we have 1 meta store for PROD and NON-PROD ? if Yes in the backend there would be a one storage account (ADLS Gen2) > Container for all Environments.
