Will enabling Unity Catalog affect existing user access and jobs in production?

[564824]

Hi, at my company, we are using Databricks with AWS IAM identity center as single sign on, I was looking into Unity catalog which seems to offer centralized access but I wanted to know if there will be any downside like loss of existing user profile data, workspace notebooks or denial of access which may cause jobs to break.

[Atanu]

You can look into this doc https://docs.databricks.com/en/data-governance/unity-catalog/migrate.html which have some details about your question here. 

[Kaniz_Fatma]

Hi @564824, 

Using Databricks Unity Catalog with AWS IAM identity centre as a single sign-on will not result in losing existing user profile data, workspace notebooks, or denial of access.
- When using SCIM provisioning, removing a user or group from the account SCIM will remove them from all workspaces under the account, causing them to lose their home folders and more. This can disrupt workspace access and cannot be easily restored.
- Synchronize all users and groups intending to use Databricks to the account console rather than individual workspaces to maintain consistent identities across all workspaces. If workspace-level SCIM provisioning is already set up, switch to account-level SCIM provisioning and disable the workspace-level provisioner.
- Updates to shared data tables and views are reflected in workspaces in near real-time, but column changes may take up to one minute to appear in Data Explorer. New shares and updates to shares are cached for one minute before being available for viewing and querying.
- Carefully plan and execute the transition to Unity Catalog, considering these points, to ensure smooth operation and avoid disruptions.