Unity Catalog and Instance Pool

[Gilg]

Hi Team,

Does Instance Pool supported in Unity Catalog enabled workspace?

Cheers,

G

[karthik_p]

@Gil Gonong​ As far a i know there is restriction for instance pool in UC, as UC bothers about access mode (single/shared) and few limitations . other than that there is no dependency in terms of instance pool

[Anonymous]

Hi @Gil Gonong​ 

Thank you for your question! To assist you better, please take a moment to review the answer and let me know if it best fits your needs.

Please help us select the best solution by clicking on "Select As Best" if it does.

Your feedback will help us ensure that we are providing the best possible service to you. Thank you!

[Kaniz_Fatma]

Hi @Gilg, In an Azure Databricks workspace enabled for Unity Catalog, you can leverage the power of Unity Catalog to manage data access and identity federation.

Here are the key points:

1. Unity Catalog Enablement:

   • When you enable a workspace for Unity Catalog, it means that:
     • Users within that workspace can access the same data as users in other workspaces within your account.
     • Data stewards can centrally manage data access across workspaces.
     • Data access is automatically audited.
     • Identity federation is enabled, allowing admins to manage identities centrally.
   • To enable an Azure Databricks workspace for Unity Catalog, you assign the workspace to a Unity Catalog metastore. A metastore serves as the top-level container for data in Unity Catalog, providing a 3-level namespace (catalog.schema.table) for organizing data.
   • You can share a single metastore across multiple Azure Databricks workspaces in an account, ensuring consistent data views and access control.

2. Considerations Before Enabling:

   • Before enabling a workspace for Unity Catalog, consider the following:
     • Understand the privileges of workspace admins in Unity Catalog-enabled workspaces.
     • Review existing workspace admin assignments.
     • Workspace admins can manage operations within their workspace, including job ownership and notebook access. While they cannot directly manage data access in Unity Catalog, their roles should be distributed carefully.
     • If you use workspaces to isolate user data access, consider using workspace-catalog bindings.

3. Consuming Data Products:

   • To consume data products using a Databricks workspace enabled for Unity Catalog:
     • You need an Azure Databricks account on the Premium plan.
     • Your workspace must be enabled for Unity Catalog.
     • You can get a free trial if you don’t have an enabled workspace.

Remember, Unity Catalog simplifies data management and access control, making collaborating easier across workspaces! 🌟🔍

For more details, refer to the official documentation.