Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
Hi all,I am getting an error when I try to 'Browse' an external location in catalog explorer through Databricks UI.This is the error I get: Error loading files.Input path url 'abfss://dbx-ccc-hive-metastore-unity-catalog@xxxxxxxxxx.dfs.core.windows.n...
Adding some tips...It seems that you have created a metastore with root path definition (metastore-level managed storage). If you're planning to deploy a multi-workspace environment (Development, QA and Production), I strongly recommend you to change...
Hi all,There is no official doc with a step-by-step process to enable Unity Catalog in azure databricks.If anyone has created doc or has the process, please share it here.Thanks, in advance.
Hi everyone!I have an Azure for Students subscription. Since I am unable to be an Azure Active Directory Global Administrator, I tried but it is restricted by the organization to add my user as a Global Administrator, I guess with an Azure for Studen...
I get an error message saying I Error getting sample data, when I try to view sample data from a table in a schema I created in a Unity Catalog. I dropped the schema and table and got a collague to recreate and still the same message. We are both Uni...
It sounds like a permissions issue. Even though both of you are Unity Catalog Admins, there might be some hidden discrepancies. Since you can query the data but can't view sample data, it could be a UI bug. Double-check the permissions at the schema ...
Currently, we must re-run our DLT pipelines anytime we want to add/modify a table or column description to unity catalog.Is this the only way to add/modify unity catalog descriptions?Is there functionality within databricks cli / sdk that we can leve...
Comments for schemas and tables may be updated using SQL DDL statement COMMENT ON.Comments for columns are updated using: ALTER TABLE <table-name> ALTER COLUMN <column-name> COMMENT '<comment-text>'; The <column-name> for nested STRUCTS follows simp...
Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...
I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.
Message: Hi Databricks Community,I encountered an error while attempting to create a Metastore in Databricks. The error message is as follows:Error: cannot create metastore: This account with id ******************** has reached the limit for Metastor...
Even i am getting same error when i try to modify metastore with terraform script , i am using below script for same.( I have already the metastore in same region but i am not able to update the setting )resource "databricks_metastore" "example" { pr...
1: Has the RBAC Time based Grants been released?2: Can you provide an example of how to Setup a Time based Grant?3: Can Time based Grants be at a Time (HH:MM) and Date Level?
Hello everyone,I have just setup a Workspace and metastore in Azure Databricks, that by default enables Unity Catalog. I have defined several groups of users in our Account but when searching for that groups in the compute permissions dialog (no matt...
Hi, Sorry, I have already found the solution: from Databricks Account -> Workspaces -> open your specific workspace (Manage workspace) than add these already created groups with a role (User or Admin) in Permissions. Next, you'll be able to assign th...
Hi all,Is there any way to implement delta sharing in databricks without enabling the unity catalog?
Is it possible to receive data in databricks notebook without enabling the unity catalog?
Hi,The client secret recently expired and I updated the configuration with the new secret. From then on, I'm not able to access the data from ADF using the delta lake component, and here is the error message I keep getting:HTTP Error 401; url='https:...
Hi @saiV06, To resolve this, ensure you're using the correct client secret value, not the client secret ID. Verify the secret value, especially if it contains special characters, and ensure they are correctly encoded. Update the client secret in all ...
Hello all, I having an issue which after trying different things, still not able to find the root cause of the problem.I have my Teraform databrick provider configure like this:Databricks provider version= v1.49.1provider "databricks" {host = module....
Solution to this issue:Instead of configuring the provider like this:provider "databricks" { host = module.databricks.databricks.workspace_url}first save the value in a local and use it in the provider, like this:locals { my_url = module.databric...
Is it possible to create an access package in Azure Identity governance and with that grant access to certain workspace objects?The idea being that a set of differing access packages can be created giving difference levels of access (in effect roles)...
Hi @IONA, Yes, you can create access packages in Azure Identity Governance to manage access to various resources. To do this, sign in to the Microsoft Entra admin center, navigate to Identity governance > Entitlement management > Access package, and ...
I am currently working on syncing workspaces in Databricks Accounts console, and I came across the command databricks-labs-ucx sync-workspace-info. I am wondering if this command is suitable for both UCX (Unity Catalog) assessments and other non-UCX ...
Hi there, you can use UCX sync to get an inventory of everything in your workspaces and track it as you upgrade to avoid cross workspace duplication where there's not a 1:1 mapping. It's designed for Unity Catalog upgrades, so whilst it's battle test...
Hi Databricks Community,I am currently working on integrating SCIM provisioning for user and group management in Databricks. I need to configure the SCIM endpoint and token for automated user provisioning.Could you please confirm if there is a specif...
Hi @Padmaja, Thanks for reaching out! Please review the response and let us know if it answers your question. Your feedback is valuable to us and the community. If the response resolves your issue, kindly mark it as the accepted solution. This will h...
Setup UCX from Databricks web terminal For cases when your desktop or laptop will not support the databricks labs install ucx technical requirements such as Python 3.10, administrative access, python package access or network access but your Databric...
Hi @DouglasMoore,I would like to provide some clarification regarding the commands mentioned in your post about DBR 15.1 or above. Contrary to what was stated, these commands are indeed necessary. Recently, when attempting to install UCX via the web ...
