- 6313 Views
- 7 replies
- 9 kudos
I do not find "Create Catalog "and "Create Metastore" on Azure Databricks.
I am trying to set up Unity Catalog in Azure Databricks following this documentation Unity Catalog, but I do not find "Create Metastore" and "Create Metastore" on Databricks.Please help with the same, how can I enable Unity Catalog.
- 6313 Views
- 7 replies
- 9 kudos
- 9 kudos
This issue is resolved. Thank you @Camilla Lok​ and @Harun for the suggestions. It works fine after enabling Global administrators in Azure Active Directory .
- 9 kudos
- 17795 Views
- 12 replies
- 1 kudos
Azure Create Metastore button not available
Dear community, I want to configure the unity catalog with databricks, but the Create MetaStore button does not appear in my Azure Databricks workspace.In the community, I have seen that several users present the same situation ... What is the reason...
- 17795 Views
- 12 replies
- 1 kudos
- 1 kudos
If I am the owner of the Azure Subcription and databricks premium is in my resource group that makes me owner on that RG as well as Databricks i am still not able to see Metastore setting for unity catalog .. have someone found a resolution to this. ...
- 1 kudos
- 21590 Views
- 15 replies
- 4 kudos
In Azure Databricks Delta Lake not able to see unity catalog databases or tables in the drop down.
I have created an Azure data factory pipeline with a copy data function to copy data from adls path to a delta table .In the delta table drop downs i am able to see only the hive metastore database and tables only but the unity catalog tables are not...
- 21590 Views
- 15 replies
- 4 kudos
- 4 kudos
Any further updates on this? I also have the same problem. I tried above solutions, but no luck. By default, it shows only default and it's tables and I can preview those tables. If I enter the <catalog>.<schema> manually, it populates all the tables...
- 4 kudos
- 13073 Views
- 6 replies
- 6 kudos
I can´t used Unity Catalog
Hi, i try to used Unity Catalog in my workspace but i don´t get it!I have followed all the steps in this video and this is my group resource in Azure: After, i change Access control (IAM):Now i have the rol as Administrator and Owner in workspace.But...
- 13073 Views
- 6 replies
- 6 kudos
- 6 kudos
Hi Everyone,I’m facing the same issue with Azure Databricks and was hoping someone could help.When I create an Azure Databricks workspace using the Azure subscription provided by my company, the workspace automatically attaches to the company’s Activ...
- 6 kudos
- 11423 Views
- 10 replies
- 4 kudos
Resolved! Step by step process to create Unity Catalog in Azure Databricks
Hi all,There is no official doc with a step-by-step process to enable Unity Catalog in azure databricks.If anyone has created doc or has the process, please share it here.Thanks, in advance.
- 11423 Views
- 10 replies
- 4 kudos
- 4 kudos
Hi everyone!I have an Azure for Students subscription. Since I am unable to be an Azure Active Directory Global Administrator, I tried but it is restricted by the organization to add my user as a Global Administrator, I guess with an Azure for Studen...
- 4 kudos
- 17355 Views
- 9 replies
- 10 kudos
Resolved! Metastore creation - Azure Databricks - Access validation failed
Hi, Getting "Access validation failed" when trying to create a metastore. Anyone noticed anything extra needed to be done except for what's written in the azure guides below? Any help on how to succeed with creating a metastore would be deeply apprec...
- 17355 Views
- 9 replies
- 10 kudos
- 10 kudos
I was told this was a bug that was fixed on Monday. We’re using AWS, and I was able to create the metastore on Tuesday without error.
- 10 kudos
- 5694 Views
- 4 replies
- 2 kudos
Resolved! Databricks-connect 11.3 works with Unity Catalog ?
Databricks-connect 11.3 works for unity catalog enabled cluster or not ? I am trying to utilize the databricks-connect in Azure DevOps pipeline using Microsoft hosted agent. But getting the below error when running the databricks-connect test command...
- 5694 Views
- 4 replies
- 2 kudos
- 2 kudos
Hi @Rey Jhon​ Sadly, databricks-connect for DBR versions < 13 does not support UC, as outlined in the limitations section: https://docs.databricks.com/dev-tools/databricks-connect-legacy.html#limitations.To use UC, we recommend using DBR version >= 1...
- 2 kudos
- 9443 Views
- 4 replies
- 19 kudos
Unity Catalog: create the first metastore The great benefit of the Unity catalog is that data is ours and stored in an open format on cloud storage in...
Unity Catalog: create the first metastoreThe great benefit of the Unity catalog is that data is ours and stored in an open format on cloud storage in our container. To install the unity catalog, we need to create storage and give databricks access to...
- 9443 Views
- 4 replies
- 19 kudos
- 19 kudos
This is very good. Can you explain on how it is providing Data governance across the Organization? With this we create a catalog and Organization can manage can create branches under this catalog, but still there should be governance rules need to be...
- 19 kudos
- 12324 Views
- 2 replies
- 1 kudos
Databricks Account in Azure
Hi,We have been piloting databricks using unity catalog in development in our azure development subscription. We are looking at plans for moving to production\live which is a completely different azure subscription. I created a workspace in product...
- 12324 Views
- 2 replies
- 1 kudos
- 1 kudos
@Andy Skinner​ When you create your workspace that will be tied to your databricks account.your account will be tied to subscription and resource group .from E2 architecture you can create multiple workspaces (in different regions) in one databricks ...
- 1 kudos
- 13013 Views
- 8 replies
- 13 kudos
Publish data to Azure ADLS Gen2 from Delta Live Tables pipelines?
I would like to publish data from from delta live table (DLT) to an Azure ADLS Gen2 storage. Checked the documentation but cannot get it to work. Any insights on how to do so?I've tried to specify the "Storage location" with many combinations of abfs...
- 13013 Views
- 8 replies
- 13 kudos
- 13 kudos
I am trying to load from ADLS with DLT, after add the spark configurations I got below errors:org.apache.spark.sql.streaming.StreamingQueryException: [STREAM_FAILED] Query [id = 818323fc-80d5-4833-9f46-7d1afc9c5bf7, runId = 722e9aac-0fdd-4206-9d49-68...
- 13 kudos
- 7763 Views
- 6 replies
- 4 kudos
Migration of Unity Catalog files with Databricks migration tool
Hi there,I'm currently migrating Databricks (metastores, workspaces, etc.) from Azure to AWS using the Databricks migration tool. During the migration process and after digging in the code, I've come to the conclusion that the tool only supports a mi...
- 7763 Views
- 6 replies
- 4 kudos
- 4 kudos
@Nino Weingart​ :Q1: You are correct that the Databricks migration tool only supports migration of the built-in Hive metastore and not custom metastores in Unity Catalog. If you want to migrate custom metastores, you would need to extend the code and...
- 4 kudos
- 4284 Views
- 3 replies
- 4 kudos
Advanced Search on Tables getting error
I click on the Search box on the top bar of the databricks workspace and select "Open advanced search". A dialog pops up with the Tables tab selected and an error below that says: "An error occurred while fetching search results. Please try again lat...
- 4284 Views
- 3 replies
- 4 kudos
- 4 kudos
Hi @John Urban​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we...
- 4 kudos
- 9307 Views
- 5 replies
- 0 kudos
Resolved! Unclear validation error message when adding a Unity Catalog metastore in Azure
I'm using Azure Databricks.I've been following this guide to create a Unity Catalog metastore using a managed identity.When I create the catalog and the validation step kicks off, I get this screen: What does this mean?If I click "Force create" and t...
- 9307 Views
- 5 replies
- 0 kudos
- 0 kudos
Hi @Alex Loddengaard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...
- 0 kudos
- 2289 Views
- 2 replies
- 0 kudos
How this is possible? access error in storage, after selecting data from an delta IN THE STORAGE
Hi people, i`m using databricks Runtime 11.2 - Clusters Standard_F4 with Unity Catalog enabled and the service principals working,I literally perform an select in two delta tables that is in the storage X, the display() works, if i try to write an ne...
- 2289 Views
- 2 replies
- 0 kudos
- 0 kudos
Hi @Guilherme Cesar​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us ...
- 0 kudos
- 7332 Views
- 2 replies
- 3 kudos
dbutils.fs.ls doesn't work on Unity catalog managed location
Hi,dbutils.fs.ls() is a most useful utility to list the files in remote cloud storage. I cannot use this function on top of the location managed by the Unity catalog.I have a managed external location created on `'abfss://xyz@abcd.dfs.core.windows.ne...
- 7332 Views
- 2 replies
- 3 kudos
- 3 kudos
Hi @Venkadeshwaran K​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answ...
- 3 kudos