cancel
Showing results forย 
Search instead forย 
Did you mean:ย 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results forย 
Search instead forย 
Did you mean:ย 

Built-In Governance for Your Databricks Workspace

Sujitha
Databricks Employee
Databricks Employee

Databricks Unity Catalog simplifies data and AI governance by providing a unified solution for organizations to securely discover, access, monitor, and collaborate on a range of data and AI assets. This includes tables, ML models, files and functions, ultimately boosting productivity and unlocking the full potential of the Lakehouse environment.

Today, we're excited to announce that Unity Catalog is now pre-configured and accessible in new premium workspaces on AWS and Azure, marking a significant milestone in our journey. Rollout for this feature will proceed gradually across accounts and regions. Reach out to your account representative for more details.

Overview of your workspace preconfigured with Unity Catalog

Youโ€™ll notice a few new features in your workspace.

 
Screenshot 2024-01-12 at 1.50.49โ€ฏPM.png
Databricks Unity Catalog enabled in a workspace
  1. The workspace now arrives with pre-configured access to Unity Catalog! No need for subsequent enablement steps by an account admin.
  2. Youโ€™ll find a catalog named after your workspace (โ€˜acme prodโ€™ in this example). This catalog serves as a place for you to put your data and AI assets, such as tables, models, files, and functions. This catalog uses cloud storage dedicated to your workspace to store underlying data.
  3. The catalog is owned by the admins of the workspace, meaning they can further administer it. For example, they can create โ€˜schemasโ€™ within the catalog to further organize assets and choose who can add assets to those schemas.Within the catalog youโ€™ll find a schema called โ€˜defaultโ€™ in which all workspace users can create assets (These permissions can be refined by the workspace admin if desired).
  4. This release builds on previous versions of Databricks and still arrives pre-configured with access to a Hive metastore. You can nominate the catalog that your workspace will use by default via a new setting called โ€˜Default catalog for the workspaceโ€™ (AWS | Azure).

3 things you should try today with Unity Catalog!

Now that your workspace has access to Unity Catalog, a whole host of features become available to you! Here are three things that you should try today using the notebook!

Create a catalog of your organizationโ€™s data and AI assets and share them securely

Democratizing data and AI requires ensuring the accessibility and security of data and AI assets. Unity Catalog simplifies this process by providing users with a central hub for effortlessly managing their data and AI resources. This empowers users to generate tables, AI models, functions, and files and catalog them in one place while maintaining access controls and auditability.

Watch the demo below to see how you can register data and AI assets and define access permissions.

Explore real-time data lineage

Unity Catalog offers real-time inference of data lineage for all your workloads, down to the column level. This feature helps you build trust in your data and AI assets, conduct impact analysis, and fuel data discovery for your end users

Watch the demo below to see data lineage in action.

Apply fine-grained row and column-level security

Unity Catalog streamlines access policy administration, enabling the creation of fine-grained permissions at both row and column levels for your Databricks workloads. Its cloud-agnostic SQL-based interface ensures a straightforward and user-friendly experience. Explore the guides (AWS, Azure, and GCP) to learn more about row filters and column masks in Unity Catalog.

Watch the demo below to see column-masking in Unity Catalog.

Looking for more resources?

By adopting Unity Catalog as the cornerstone of your Lakehouse architecture, you unlock the potential of a flexible and scalable governance solution that spans your entire data and AI ecosystem. For comprehensive documentation, refer to the Unity Catalog guides available for AWS, Azure, and GCP. For additional tutorials, please visit Databricks Demo Center for more tutorials on Unity Catalog. Download the free eBook on Data and AI governance to learn more about how Databricks Lakehouse Platform addresses data and AI governance challenges.

Elevate your data strategy with peace of mind. Ready to strengthen your governance game? Click here to implement robust governance in your Databricks Workspace today!

 

1 REPLY 1

jose_gonzalez
Databricks Employee
Databricks Employee

Thank you for sharing this @Sujitha 

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you wonโ€™t want to miss the chance to attend and share knowledge.

If there isnโ€™t a group near you, start one and help create a community that brings people together.

Request a New Group