Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
Currently, Databricks allows us to grant access to catalogs, schemas, and objects individually, but this process can be repetitive and time-consuming when managing access for multiple applications across different schemas. A feature that enables the...
Hi @sdheepak, Thanks for reaching out! Please review the response and let us know which best addresses your question. Your feedback is valuable to us and the community. If the response resolves your issue, kindly mark it as the accepted solution. Thi...
Hello,Is there any plan to support the equivalent of fabric semantic-link on Databricks? Essentially, having the ability to query PowerBi Dataset using SQL on interactive/jobs cluster and SQL warehouse (i.e a Unity Catalog federated source being Powe...
I think partners connect give option to connect BI tools and their sementic models to DBX not DBX to SM,in case you want to use models used for reports for AI/ML processing in dbx, you need to use something like semantic link to get data from SM dire...
We have an existing metastore in a region. We would like to delete it (Create a Unity Catalog metastore - Azure Databricks | Microsoft Learn) and create a new metastore in that same region. Are there any issues that we should be aware of with creatin...
I have exactly the same query.But before that, is it at all a good practice to delete the default metastore ? I am asking this because Databricks creates a lot of things on the Azure side like a storage account, access connector, managed identity, li...
Hi all,There is no official doc with a step-by-step process to enable Unity Catalog in azure databricks.If anyone has created doc or has the process, please share it here.Thanks, in advance.
Hi everyone!I have an Azure for Students subscription. Since I am unable to be an Azure Active Directory Global Administrator, I tried but it is restricted by the organization to add my user as a Global Administrator, I guess with an Azure for Studen...
Currently, we must re-run our DLT pipelines anytime we want to add/modify a table or column description to unity catalog.Is this the only way to add/modify unity catalog descriptions?Is there functionality within databricks cli / sdk that we can leve...
Comments for schemas and tables may be updated using SQL DDL statement COMMENT ON.Comments for columns are updated using: ALTER TABLE <table-name> ALTER COLUMN <column-name> COMMENT '<comment-text>'; The <column-name> for nested STRUCTS follows simp...
Hi!So I've been looking into trying Unity Catalog since it seems to add many great features.But one thing I cant get my head around is the fact that we cant (shouldn't?) use multiple metastores in the same region in UC.Let me explain my usecase:We ha...
I think the answer to this issue is have accounts by environment. Would be better if Databricks introduced an Organisations features as per AWS.
Message: Hi Databricks Community,I encountered an error while attempting to create a Metastore in Databricks. The error message is as follows:Error: cannot create metastore: This account with id ******************** has reached the limit for Metastor...
Even i am getting same error when i try to modify metastore with terraform script , i am using below script for same.( I have already the metastore in same region but i am not able to update the setting )resource "databricks_metastore" "example" { pr...
1: Has the RBAC Time based Grants been released?2: Can you provide an example of how to Setup a Time based Grant?3: Can Time based Grants be at a Time (HH:MM) and Date Level?
Hello everyone,I have just setup a Workspace and metastore in Azure Databricks, that by default enables Unity Catalog. I have defined several groups of users in our Account but when searching for that groups in the compute permissions dialog (no matt...
Hi, Sorry, I have already found the solution: from Databricks Account -> Workspaces -> open your specific workspace (Manage workspace) than add these already created groups with a role (User or Admin) in Permissions. Next, you'll be able to assign th...
Hi all,Is there any way to implement delta sharing in databricks without enabling the unity catalog?
Is it possible to receive data in databricks notebook without enabling the unity catalog?
Hi,The client secret recently expired and I updated the configuration with the new secret. From then on, I'm not able to access the data from ADF using the delta lake component, and here is the error message I keep getting:HTTP Error 401; url='https:...
Hi @saiV06, To resolve this, ensure you're using the correct client secret value, not the client secret ID. Verify the secret value, especially if it contains special characters, and ensure they are correctly encoded. Update the client secret in all ...
Hello all, I having an issue which after trying different things, still not able to find the root cause of the problem.I have my Teraform databrick provider configure like this:Databricks provider version= v1.49.1provider "databricks" {host = module....
Solution to this issue:Instead of configuring the provider like this:provider "databricks" { host = module.databricks.databricks.workspace_url}first save the value in a local and use it in the provider, like this:locals { my_url = module.databric...
Is it possible to create an access package in Azure Identity governance and with that grant access to certain workspace objects?The idea being that a set of differing access packages can be created giving difference levels of access (in effect roles)...
Hi @IONA, Yes, you can create access packages in Azure Identity Governance to manage access to various resources. To do this, sign in to the Microsoft Entra admin center, navigate to Identity governance > Entitlement management > Access package, and ...
I am currently working on syncing workspaces in Databricks Accounts console, and I came across the command databricks-labs-ucx sync-workspace-info. I am wondering if this command is suitable for both UCX (Unity Catalog) assessments and other non-UCX ...
Hi there, you can use UCX sync to get an inventory of everything in your workspaces and track it as you upgrade to avoid cross workspace duplication where there's not a 1:1 mapping. It's designed for Unity Catalog upgrades, so whilst it's battle test...
Hi Databricks Community,I am currently working on integrating SCIM provisioning for user and group management in Databricks. I need to configure the SCIM endpoint and token for automated user provisioning.Could you please confirm if there is a specif...
Databricks has SCIM support at both the workspace and account levels. With Unity Catalog you should be using the account level so you may ignore any workspace level SCIM instructions. The documentation will be slightly different for each cloud.AWS:...
