Hi @Janga Reddy​ Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers y...
Hi,I have two questions about cluster logs.Q1) It seems that I can only store logs on DBFS. But, is there any way I can send the cluster logs to an Azure storage account?Note that workspace is not enabled for the Unity Catalog (and is not aimed to be...
Hi @Mohammad Saber​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us s...
Hello,Is it possible to use multiple Hive catalogs with Databricks? I know it can be done with Unity Catalog, but we're the only workspace admins in our organization. As far as I understand, we'd need account-level access to set up Unity Catalog.Best...
Hi @Chris Nawara​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so ...
Hi there,We have Unity Catalogs enabled in Azure Databricks.I would like to connect to system.information_schema.* or any other *.information_schema.*. Querying in UI or other IDEs works as expected - select * from system.information_schema.tables.No...
Hi @Egor Larin​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
Hello, I have been trying to solidify my understanding of what changes occur after I upgrade my data to Unity Catalog. Our current ingestion process incrementally loads new data to tables in the hive metastore which are mounted to an s3 bucket. If I ...
Hi @Rachel Cunningham​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you....
Based on the instructions for creating an external table (see: https://docs.databricks.com/data-governance/unity-catalog/create-tables.html#create-a-table) I had assumed that external tables were a way to add an existing object store to Unity Catalog...
@Mark Miller​ :External tables in Databricks do not automatically receive external updates. When you create an external table in Databricks, you are essentially registering the metadata for an existing object store in Unity Catalog, which allows you ...
Hi @Jim Burris​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
I am setting up a new workspace that will use the Unity Catalog. I want all data stored in the Unity Catalog in the following catalogs: dev, staging, prod. I want to prevent users from accidentally reading and writing data elsewhere.For the above sit...
@Kevin Rossi​ @John Lourdu​ - I am also new to databricks setting up environment. Bu default "all users" have read access to below mentioned catalogs,my question is - i see an option to revoke read access, is it must have read access to all these ca...
I am trying to add a GCP storage as an external location and read and write Unity catalog enabled delta tables to that external location in GCP databricks. I keep getting the error that the databricks instance service principal doesn't have access to...
Hi there,I'm currently migrating Databricks (metastores, workspaces, etc.) from Azure to AWS using the Databricks migration tool. During the migration process and after digging in the code, I've come to the conclusion that the tool only supports a mi...
@Nino Weingart​ :Q1: You are correct that the Databricks migration tool only supports migration of the built-in Hive metastore and not custom metastores in Unity Catalog. If you want to migrate custom metastores, you would need to extend the code and...
Hello, there are a bunch of pages in the documentation that mention tables and views can be created via Terraform:> You can also create a managed table by using the Databricks Terraform provider and databricks_table. But those links to `databricks_ta...
Hmm it seems that Databricks developers say that creating tables/views in Unity Catalog from TerraForm is discouraged:> so there are quite a few gaps/edge cases with the tables API, hence customers should not use the API or Terraform to create/manage...
I am trying to list OBO tokens that have been created for service principals. I tried using the Token Management API 2.0 (https://docs.databricks.com/dev-tools/api/latest/token-management.html#operation/get-tokens) to list workspace tokens, but it on...
Hi @Nick Tran​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us so we ...
We have an existing metastore in a region. We would like to delete it (Create a Unity Catalog metastore - Azure Databricks | Microsoft Learn) and create a new metastore in that same region. Are there any issues that we should be aware of with creatin...
Hi @Jennette Shepard​ Hope everything is going great.Just wanted to check in if you were able to resolve your issue. If yes, would you be happy to mark an answer as best so that other members can find the solution more quickly? If not, please tell us...
Hi, i try to used Unity Catalog in my workspace but i don´t get it!I have followed all the steps in this video and this is my group resource in Azure: After, i change Access control (IAM):Now i have the rol as Administrator and Owner in workspace.But...
Hi @Kaniz Fatma​ i´m owner to the workspace of Databricks but i can´t used Unity Catalog,I tried install dbdemo about Unity Catalog:%pip install dbdemos
import dbdemos
dbdemos.install('uc-03-data-lineage')it created a notebook and cluster, but the ...
