Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
Hello,I am using Unity catalog on my databricks and all of my data resides in data lake which is located in west europe.I have to onboard the Korea data to UC which is present on data lake pointing to south korea regionMy question is do I need to set...
I think what you're asking is if you need a new metastore for your Korea data. The technical answer is no. You can just onboard the Korean storage account as an external location in your west europe based Metastore. However you can't onboard Databric...
Hi all, I recently enabled SSO on my Databricks account. Now, when a user signs in they see "No workspaces have been enabled for your account", which is the expected behavior as I haven't created any workspaces yet. However, when I try to sign in wit...
Open Sourcing of Unity Catalogue is a game changer. Governance has new name now which is Unity Catalogue
Can delta sharing have row, column-level acls?
You can filter row/column using dynamic view along with delta sharing. Here is the documentation: https://docs.databricks.com/en/data-sharing/create-share.html#add-dynamic-views-to-a-share-to-filter-rows-and-columns
is there any documentation on the best practices for setting up the user groups in azure databricks?
We recommend to use identity federation for user groups setup. You can refer the following documentation for details: https://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices
Unity catalog migrations for great
FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/FileStore/config.share'When I am trying to read the config.share file, it is throwing this error. I tried with spark path format as well which is dbfs:/FileStore/config.share' but it also...
On Unity Catalog Shared Access Mode clusters you need to use a UC Volume to read (config) files using vanilla Python (with open() for example that many libs use). You can no longer read files from DBFS this way. This is all part of the new security m...
I just got through reading the great technical blog post from @SergeRielau about session variableshttps://community.databricks.com/t5/technical-blog/sql-session-variables-stash-your-state-and-use-it-too/bc-p/72453#M193Super useful facility and well ...
Hi,I am trying to obtain SOC compliance documents for my company. Despite following the instructions of the AI assistant, I can't find anywhere to submit a support ticket to get these documents. Has anyone had experience with this issue in the past w...
You can contact your Databricks account executive (sales representative), they should be able to get you the copy of SOC compliance reports.
Hi I was wondering how you would apply tags to tables, columns etc in unity catalog through code?One use case i want to have a look at is by automatically applying PI classification against certain tables and columns that contain certain words.Is thi...
Using sql:https://docs.databricks.com/en/data-governance/unity-catalog/tags.html#manage-tags-using-sql-commandsI am not aware of a python/scala counterpart (but using spark.sql() that is no issue).
We have observed that the latest UCX version includes some jobs for migrating tables. Could you please confirm if these jobs will handle the actual migration of tables to Unity Catalog automatically? Or do we need to write our own scripts to complete...
What is the vision of uc and purview , on government
There's some changes to Purview coming out that enable users to create Data Products in Purview as the start of a Data Fabric which is realized in Databricks. ER/Studio allows you to design structures with well-formed data models of your Databricks L...
Optimizing Your Site’s Branded Search - 5 Simple Ways Trusted by Every SEO Agency SydneyWhat is Branded searching Simply told, brand searches occur when individuals type your WP Creative in search engines like Google, Yahoo etc. Since customers are d...
HikeMyTraffic® provided excellent insights on Optimizing Your Site’s Branded Search. Their approach, along with strategies from SeoProfy and Livepage, made it easier to boost brand visibility. Highly recommend their expertise in enhancing branded sea...
We are facing an issue related to the Data type mismatch when performing the federation queries (link).Basic need is to perform union on these both tables from federated(system tables) and system tables (target/current workspace).Problem: Struct and...
System table data is available at the account level. If you are trying LH Federation for querying system tables isn't that already available in the source workspace? https://docs.databricks.com/en/admin/system-tables/index.html#what-are-system-table...
When creating a Unity catalog using a service principal token, the created catalog isn't visible or accessible to other users (even admins) via GUI nor CLI.It seems that only when I change the catalog's ownership to some other user it is visible.Why ...
Right after the creation of the catalog, add a new grant statement. Check here please.
