Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
Hi all,Is there any way to implement delta sharing in databricks without enabling the unity catalog?
Is it possible to receive data in databricks notebook without enabling the unity catalog?
Hi,The client secret recently expired and I updated the configuration with the new secret. From then on, I'm not able to access the data from ADF using the delta lake component, and here is the error message I keep getting:HTTP Error 401; url='https:...
Hi @saiV06, To resolve this, ensure you're using the correct client secret value, not the client secret ID. Verify the secret value, especially if it contains special characters, and ensure they are correctly encoded. Update the client secret in all ...
Hello all, I having an issue which after trying different things, still not able to find the root cause of the problem.I have my Teraform databrick provider configure like this:Databricks provider version= v1.49.1provider "databricks" {host = module....
Solution to this issue:Instead of configuring the provider like this:provider "databricks" { host = module.databricks.databricks.workspace_url}first save the value in a local and use it in the provider, like this:locals { my_url = module.databric...
Is it possible to create an access package in Azure Identity governance and with that grant access to certain workspace objects?The idea being that a set of differing access packages can be created giving difference levels of access (in effect roles)...
Hi @IONA, Yes, you can create access packages in Azure Identity Governance to manage access to various resources. To do this, sign in to the Microsoft Entra admin center, navigate to Identity governance > Entitlement management > Access package, and ...
I am currently working on syncing workspaces in Databricks Accounts console, and I came across the command databricks-labs-ucx sync-workspace-info. I am wondering if this command is suitable for both UCX (Unity Catalog) assessments and other non-UCX ...
Hi there, you can use UCX sync to get an inventory of everything in your workspaces and track it as you upgrade to avoid cross workspace duplication where there's not a 1:1 mapping. It's designed for Unity Catalog upgrades, so whilst it's battle test...
Hi Databricks Community,I am currently working on integrating SCIM provisioning for user and group management in Databricks. I need to configure the SCIM endpoint and token for automated user provisioning.Could you please confirm if there is a specif...
Databricks has SCIM support at both the workspace and account levels. With Unity Catalog you should be using the account level so you may ignore any workspace level SCIM instructions. The documentation will be slightly different for each cloud.AWS:...
Hello Databricks Community,I'm seeking advice and insights on best practices for managing data access and permissions in Databricks. Our company currently uses a view-based approach for access control, but I'm wondering if we should transition to Dat...
Hello Databricks Community,I am currently facing an issue while trying to export and import all catalogs from an old workspace to a newly created workspace using Databricks' REST API and Python. Here's a summary of my situation:Objective: I am attemp...
Hi everyone,I wanted to follow up on my previous question about exporting hive_merastore catalog from existing workspace and import it to a new workspace along with all its dependencies using rest api ,if not other alternative solution how to import ...
Is there any way of hide definition of view in unity catalog?
Hi @mahfooz_iiitian ,Currently there is no such an option in unity catalog.
Hello friends! Do we have any certifications for Unity Catalog in Databricks?
@Techelligence You can find the Platform Administrator path from here: https://customer-academy.databricks.com//lms/index.php?r=coursepath/deeplink&id_path=207&hash=1003b93351e6a5abe05aa342f12b1458f6ac2799&generated_by=714319There are many other cert...
I'm creating a unity catalog using terraform on Azure. The first couple of apply worked just fine, no error at all, but suddenly today when i wanted to incorporate another change to the code which was not related to databicks, terraform started givin...
Hi @JustLeo , You haven't provided how you defined resource, but maybe you're missing depends on clause?According to terraform documentation:In Terraform 0.13 and later, data resources have the same dependency resolution behavior as defined for m...
Here's your Data + AI Summit 2024 - Data Governance recap as you navigate the explosion of AI, data and tools in efforts to build a flexible and scalable governance framework that spans your entire data and AI estate. Keynote: Evolving Data Governan...
We've an on-premises DB2/LUW and Z/Os database and we need to show a lineage of them. Can Unity Catalog or Purview do this? If we've the best, what would it be? Or would working with both be a better option?
I'm facing an issue while trying to create an external location in Databricks using Terraform and a service principal. The specific error message I'm encountering is:Error:Here's some context:Using Azure CLI (Az login): The creation of the external l...
After creating the databricks_metastore resource, can you run databricks_grants? like this resource "databricks_grants" "foo" { depends_on = databricks_metastore.foo metastore = databricks_metastore.foo.id grant { principal = <your service ...
I'm encountering an issue with my Terraform code for creating a cluster. The terraform plan command runs successfully and shows the correct changes, but the after that fails with errors. Here are the details: Terraform Code:terraform {required_provid...
Are you getting two different errors?default auth error usually means you you need to explicitly set the providers in either the data or resource objects as well, or you're missing a depends_on attribute. I think for both cases it is the latter. i.e....
