Alberto_Umana
Databricks Employee
Databricks Employee

Unity Catalog Setup:

  • Catalog and Schema Levels: Use Unity Catalog to manage and organize your tables. Create separate catalogs or schemas for each layer of the medallion architecture. This way, the assistant can interpret the context based on the catalog or schema rather than relying on table name prefixes or suffixes.
  • Access Control: Unity Catalog provides centralized access control, auditing, and data discovery capabilities. Ensure that you define access policies at the catalog or schema level to manage permissions effectively.

Example Structure:

  • Catalogs:
    • bronze_catalog
    • silver_catalog
    • gold_catalog
  • Schemas within Catalogs:
    • bronze_catalog.marketing
    • silver_catalog.marketing
    • gold_catalog.marketing
  • Tables:
    • bronze_catalog.marketing.campaign_response_us_cdc
    • silver_catalog.marketing.campaign_response_us_cdc
    • gold_catalog.marketing.campaign_response_us_cdc