cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Governance

Forum Posts

MadelynM
by Databricks Employee
  • 679 Views
  • 0 replies
  • 0 kudos

[Recap] Data + AI Summit 2024 - Data Governance | Navigate the explosion of AI, data and tools

Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...

Screenshot 2024-07-03 at 9.27.29 AM.png
  • 679 Views
  • 0 replies
  • 0 kudos
ArjunGopinath96
by New Contributor
  • 4980 Views
  • 1 replies
  • 0 kudos

Change Data Feed Cost

Greetings,I want to understand the efficiency of using Change Data Feed in tracking the changes of a table that has around 1 million rows. There will be around 20K appends in a week.  I read that to track appends CDF is not the right way-if thats tru...

  • 4980 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ravivarma
Databricks Employee
  • 0 kudos

Hello @ArjunGopinath96 , Greetings! Change Data Feed (CDF) in Delta Lake provides an efficient way to track changes in a table, including appends. It works by recording row-level changes between versions of a Delta table, capturing both the row data ...

  • 0 kudos
jv_v
by Contributor
  • 2558 Views
  • 2 replies
  • 1 kudos

Resolved! Issue Creating Metastore Using Terraform with Service Principal Authentication

I'm encountering an issue when attempting to create a metastore using Terraform with service principal authentication. Below is the error message I receive:Error:"module.metastore_and_users.databricks_metastore.this: error: cannot create metastore: d...

  • 2558 Views
  • 2 replies
  • 1 kudos
Latest Reply
jacovangelder
Honored Contributor
  • 1 kudos

You need to add the provider alias to the databricks_metastore resource, i.e.: resource "databricks_metastore" "this" { provider = databricks.azure_account name = var.metastore_name storage_root = format("abfss://%s@%s.dfs.core.windows.net/", azurerm...

  • 1 kudos
1 More Replies
jv_v
by Contributor
  • 2351 Views
  • 3 replies
  • 0 kudos

Authenticating to Accounts Console Using Client ID and Secret via Terraform and Databricks CLI

I am currently working on a project where I need to authenticate to the Databricks accounts console from Terraform using a client ID and client secret. Here is the relevant portion of my Terraform configuration:// Provider for Databricks accountprovi...

jv_v_0-1718116490905.png
  • 2351 Views
  • 3 replies
  • 0 kudos
Latest Reply
jw-dbx
Databricks Employee
  • 0 kudos

First, run following commands in shell, please replace placeholder according to your environment: export CLIENT_ID=<client id> export CLIENT_SECRET=<client secret> export TOKEN_EP=https://accounts.cloud.databricks.com/oidc/accounts/<databricks accoun...

  • 0 kudos
2 More Replies
shahname
by New Contributor II
  • 1657 Views
  • 1 replies
  • 1 kudos

Resolved! region specific issue in Unity catalog

Hello,I am using Unity catalog on my databricks and all of my data resides in data lake which is located in west europe.I have to onboard the Korea data to UC which is present on data lake pointing to south korea regionMy question is do I need to set...

  • 1657 Views
  • 1 replies
  • 1 kudos
Latest Reply
jacovangelder
Honored Contributor
  • 1 kudos

I think what you're asking is if you need a new metastore for your Korea data. The technical answer is no. You can just onboard the Korean storage account as an external location in your west europe based Metastore. However you can't onboard Databric...

  • 1 kudos
kaizad
by New Contributor
  • 401 Views
  • 0 replies
  • 0 kudos

Owner can't sign into account after enabling SSO

Hi all, I recently enabled SSO on my Databricks account. Now, when a user signs in they see "No workspaces have been enabled for your account", which is the expected behavior as I haven't created any workspaces yet. However, when I try to sign in wit...

kaizad_0-1718712452338.png
  • 401 Views
  • 0 replies
  • 0 kudos
OmkarMehta
by New Contributor
  • 6073 Views
  • 1 replies
  • 0 kudos

Delta Sharing

Can delta sharing have row, column-level acls? 

  • 6073 Views
  • 1 replies
  • 0 kudos
Latest Reply
jw-dbx
Databricks Employee
  • 0 kudos

You can filter row/column using dynamic view along with delta sharing. Here is the documentation: https://docs.databricks.com/en/data-sharing/create-share.html#add-dynamic-views-to-a-share-to-filter-rows-and-columns 

  • 0 kudos
Swethag
by New Contributor II
  • 1167 Views
  • 1 replies
  • 1 kudos

Resolved! Best practices for setting up the user groups in Databricks

is there any documentation on the best practices for setting up the user groups in azure databricks?

  • 1167 Views
  • 1 replies
  • 1 kudos
Latest Reply
jw-dbx
Databricks Employee
  • 1 kudos

We recommend to use identity federation for user groups setup. You can refer the following documentation for details: https://learn.microsoft.com/en-us/azure/databricks/admin/users-groups/best-practices 

  • 1 kudos
Data_Analytics1
by Contributor III
  • 28176 Views
  • 10 replies
  • 2 kudos

File not found error.

FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/FileStore/config.share'When I am trying to read the config.share file, it is throwing this error. I tried with spark path format as well which is dbfs:/FileStore/config.share' but it also...

  • 28176 Views
  • 10 replies
  • 2 kudos
Latest Reply
jacovangelder
Honored Contributor
  • 2 kudos

On Unity Catalog Shared Access Mode clusters you need to use a UC Volume to read (config) files using vanilla Python (with open() for example that many libs use). You can no longer read files from DBFS this way. This is all part of the new security m...

  • 2 kudos
9 More Replies
AntonioR
by New Contributor II
  • 1184 Views
  • 0 replies
  • 0 kudos

Initializing Session Variables for use in row filtering/column masking in Every Session

I just got through reading the great technical blog post from @SergeRielau  about session variableshttps://community.databricks.com/t5/technical-blog/sql-session-variables-stash-your-state-and-use-it-too/bc-p/72453#M193Super useful facility and well ...

  • 1184 Views
  • 0 replies
  • 0 kudos
eduardo_marin_n
by New Contributor
  • 527 Views
  • 1 replies
  • 0 kudos

Cannot find SOC compliance report

Hi,I am trying to obtain SOC compliance documents for my company. Despite following the instructions of the AI assistant, I can't find anywhere to submit a support ticket to get these documents. Has anyone had experience with this issue in the past w...

  • 527 Views
  • 1 replies
  • 0 kudos
Latest Reply
jw-dbx
Databricks Employee
  • 0 kudos

You can contact your Databricks account executive (sales representative), they should be able to get you the copy of SOC compliance reports. 

  • 0 kudos
Mamzy10
by New Contributor II
  • 965 Views
  • 1 replies
  • 0 kudos

Unity catalog tagging through Code

Hi I was wondering how you would apply tags to tables, columns etc in unity catalog through code?One use case i want to have a look at is by automatically applying PI classification against certain tables and columns that contain certain words.Is thi...

  • 965 Views
  • 1 replies
  • 0 kudos
Latest Reply
-werners-
Esteemed Contributor III
  • 0 kudos

Using sql:https://docs.databricks.com/en/data-governance/unity-catalog/tags.html#manage-tags-using-sql-commandsI am not aware of a python/scala counterpart (but using spark.sql() that is no issue).

  • 0 kudos
Carol2
by New Contributor II
  • 3558 Views
  • 2 replies
  • 2 kudos

unity catalog vs purview

What is the vision of uc and purview , on government 

  • 3558 Views
  • 2 replies
  • 2 kudos
Latest Reply
Idera
New Contributor II
  • 2 kudos

There's some changes to Purview coming out that enable users to create Data Products in Purview as the start of a Data Fabric which is realized in Databricks. ER/Studio allows you to design structures with well-formed data models of your Databricks L...

  • 2 kudos
1 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Labels