Governance is critical to democratize data and AI, in the era of LLMs and generative AI. In a typical enterprise, data is siloed across data warehouses and data lakes, making it difficult to manage permissions, understand the usage of data, conduct audits, or discover and share data.
But data isn’t limited to files or tables. You also have modern data assets like dashboards, machine learning models and notebooks, each with its own permission models, making it difficult to manage access permissions for all these assets consistently. The problem gets bigger when your data assets exist across multiple clouds with different access management solutions.
Databricks Data Intelligence platform provides Unity Catalog, unified governance solution for data and AI. With Unity Catalog, organizations can seamlessly govern their structured and unstructured data, machine learning models, notebooks, dashboards and files on any cloud or platform.
In this session, you will learn how to:
- Build an enterprise catalog for structured/unstructured data, files, tables, ML models, features across clouds and data platforms
- Benefit from context-aware natural language search and discovery
- Set up access permissions and audit data access
- Leverage AI to monitor quality of data and ML pipelines
- Gain comprehensive observability into your data and AI workloads with operational intelligence utilizing built-in system tables for billing, auditing, lineage
- Share data across clouds, regions or data platforms with Delta Sharing
