If you're catching up on Data + AI Summit 2026, here’s a simple Unity Catalog recap for data governance. Three themes stand out: Control, Context, and Choice. Control: Keep governance consistent as AI moves from access to action. AI governance at Dat...
Hello Databricks Community,I'm seeking advice and insights on best practices for managing data access and permissions in Databricks. Our company currently uses a view-based approach for access control, but I'm wondering if we should transition to Dat...
Hello Databricks Community,I am currently facing an issue while trying to export and import all catalogs from an old workspace to a newly created workspace using Databricks' REST API and Python. Here's a summary of my situation:Objective: I am attemp...
Hi everyone,I wanted to follow up on my previous question about exporting hive_merastore catalog from existing workspace and import it to a new workspace along with all its dependencies using rest api ,if not other alternative solution how to import ...
Is there any way of hide definition of view in unity catalog?
Hi @mahfooz_iiitian ,Currently there is no such an option in unity catalog.
Hello friends! Do we have any certifications for Unity Catalog in Databricks?
@Techelligence You can find the Platform Administrator path from here: https://customer-academy.databricks.com//lms/index.php?r=coursepath/deeplink&id_path=207&hash=1003b93351e6a5abe05aa342f12b1458f6ac2799&generated_by=714319There are many other cert...
I'm creating a unity catalog using terraform on Azure. The first couple of apply worked just fine, no error at all, but suddenly today when i wanted to incorporate another change to the code which was not related to databicks, terraform started givin...
Hi @JustLeo , You haven't provided how you defined resource, but maybe you're missing depends on clause?According to terraform documentation:In Terraform 0.13 and later, data resources have the same dependency resolution behavior as defined for m...
Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
We've an on-premises DB2/LUW and Z/Os database and we need to show a lineage of them. Can Unity Catalog or Purview do this? If we've the best, what would it be? Or would working with both be a better option?
I'm facing an issue while trying to create an external location in Databricks using Terraform and a service principal. The specific error message I'm encountering is:Error:Here's some context:Using Azure CLI (Az login): The creation of the external l...
After creating the databricks_metastore resource, can you run databricks_grants? like this resource "databricks_grants" "foo" { depends_on = databricks_metastore.foo metastore = databricks_metastore.foo.id grant { principal = <your service ...
I'm encountering an issue with my Terraform code for creating a cluster. The terraform plan command runs successfully and shows the correct changes, but the after that fails with errors. Here are the details: Terraform Code:terraform {required_provid...
Are you getting two different errors?default auth error usually means you you need to explicitly set the providers in either the data or resource objects as well, or you're missing a depends_on attribute. I think for both cases it is the latter. i.e....
I am currently working on automating Unity Catalog (UC) using Terraform, and I came across the following Terraform block: resource "databricks_metastore_data_access" "first" { provider = databricks.Workspace metastore_id = databricks_metastore.thi...
I implemented the following Terraform code for configuring a Databricks metastore data access:terraform {required_providers {azurerm = {source = "hashicorp/azurerm"}databricks = {source = "databricks/databricks"}}}provider "azurerm"{alias = "azure"sk...
Greetings,I want to understand the efficiency of using Change Data Feed in tracking the changes of a table that has around 1 million rows. There will be around 20K appends in a week. I read that to track appends CDF is not the right way-if thats tru...
Hello @ArjunGopinath96 , Greetings! Change Data Feed (CDF) in Delta Lake provides an efficient way to track changes in a table, including appends. It works by recording row-level changes between versions of a Delta table, capturing both the row data ...
I'm encountering an issue when attempting to create a metastore using Terraform with service principal authentication. Below is the error message I receive:Error:"module.metastore_and_users.databricks_metastore.this: error: cannot create metastore: d...
You need to add the provider alias to the databricks_metastore resource, i.e.: resource "databricks_metastore" "this" { provider = databricks.azure_account name = var.metastore_name storage_root = format("abfss://%s@%s.dfs.core.windows.net/", azurerm...
I am currently working on a project where I need to authenticate to the Databricks accounts console from Terraform using a client ID and client secret. Here is the relevant portion of my Terraform configuration:// Provider for Databricks accountprovi...
First, run following commands in shell, please replace placeholder according to your environment: export CLIENT_ID=<client id> export CLIENT_SECRET=<client secret> export TOKEN_EP=https://accounts.cloud.databricks.com/oidc/accounts/<databricks accoun...
Hello,I am using Unity catalog on my databricks and all of my data resides in data lake which is located in west europe.I have to onboard the Korea data to UC which is present on data lake pointing to south korea regionMy question is do I need to set...
I think what you're asking is if you need a new metastore for your Korea data. The technical answer is no. You can just onboard the Korean storage account as an external location in your west europe based Metastore. However you can't onboard Databric...
Hi all, I recently enabled SSO on my Databricks account. Now, when a user signs in they see "No workspaces have been enabled for your account", which is the expected behavior as I haven't created any workspaces yet. However, when I try to sign in wit...
