Hi All,I have created a new Unity Catalog (UC) metastore (new metastore ID) in west europe and now i want to import alle catalog/schema/tables form the old metastore (west europe) container to the new UC metastore.Note: coping all tables form the old...
Hi @Barney, To import all catalog/schema/tables from the old metastore to the new Unity Catalog (UC) metastore, you can use the Data Explorer upgrade wizard provided by Databricks.
Here are the steps:
1. Open the Data Explorer by clicking Data in th...
Currently we have an Init script that specifies the location of different network resources by updating the hosts file. When we moved to the Unity catalog all of our clusters had to be upgraded to support it. Now our scripts have stopped working due ...
Hi,when i create external location on unity catalog. even if i dont provide any user grants, i have an write access to the s3 bucket from attached workspace.i created external location xxxxi didnt allow any permissions on it on a workspace that is co...
Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...
If the two Workspaces are under the same metastore you don't need Delta Sharing because they already have access to the same data. Unless you want to do data segregation per workspace. if it's the case it's coming soon at the end of february
I have discovered some strange behavior when adding new columns to a table associated with Unity Catalog. I overwrote the data specifying overwriteSchema = True and passing in the abfss path as it is an external table. When quering against it, it is ...
Hi @Oscar Dyremyhr Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Tha...
Hi all, I have set up a Unity Catalog (UC), and I am attempting to "upgrade my Delta tables" in the hive_metastore to my new catalog.I have followed the instructions here: https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catal...
Hi,Is it possible to create groups at the account level in Unity Catalog as a Service Principal ?I can manage to create groups when authenticated as a user, but not as a Service Principal. I then get an error "user not authorized". The service princi...
I am migrating my Data Lake to use Unity Catalog. However, this comes with changes to the clusters. I have tried a few options, but it seems rather complex than it should be. I need to create a cluster used by ADF that is Unity Enabled that can insta...
I exclusively use job clusters. They are cheaper.Especially when you create a pool with spot instances. I'd go for that because that is what it's made for: batch jobs/
I am trying to execute a UDF written in Python and receive the following error message:Error message: [UC_COMMAND_NOT_SUPPORTED] UDF/UDAF functions are not supported in Unity Catalog.;The limitation is not mentioned in the docs( https://docs.databric...
Indeed it is not mentioned in the limitations.This blog mentions python UDFs in UC, but in databricks SQL, not the classic DE workspace.So it seems that it is not (yet) supported, as the docs only mention SQL functions.