Hi All, Can anyone point me to either documentation or personally tried and tested method of backing up (and restoring) Unity Catalog and its associated managed tables? We're running on Azure and using ADLS Gen2.Regards,Ashley
Our UC managed tables are stored on prod ADLS storage which is different from UC root storage account. So what's the best way to backup and restore UC managed tables into different region? One option is deep clone tables, copy ADLS folders to an...
Hi,If I update a Tag on a table within a Noetbook as follows:sql = f"""ALTER TABLE {silver_catalog}.public.tablename SET TAGS ('Is_published' = 'Y');"""spark.sql(sql)Then the User ID and Username, nor Notebook is populated when I look in the History ...
Hey there! Thanks a bunch for being part of our awesome community! We love having you around and appreciate all your questions. Take a moment to check out the responses – you'll find some great info. Your input is valuable, so pick the best solution...
Hi, This might be a silly question to ask but is it possible to enforce schema on a table created from external location, I am trying to create a table from a s3 location and my command looks like thisquery = """CREATE TABLE IF NOT EXISTS {} ...
I want to express my gratitude for your effort in selecting the most suitable solution. It's great to hear that your query has been successfully resolved. Thank you for your contribution.
I faced with error "[RequestId=b567c3bb-05fc-4ac8-b4db-2d826b2c00be ErrorClass=QUOTA_EXCEEDED] Cannot create 1 Table(s) in Metastore 95157916-5539-4dc4-a7d6-e9a854ba0591 (estimated count: 100088, limit: 100000). " but I didn't see here this limit ...
Hi, Databricks CommunityI am currently plan to do migrate of existing metastore (not in a desired account and name) to a new one (a different desired account) within the same region. I understand it is not as straightforward it might be and complicat...
Hi Databricks community! Exciting news: we open-sourced PACE (Policy As Code Engine) and launched on Product Hunt, and we'd love your input!PACE offers an abstraction on Unity Catalog data access policies, translating YAML/JSON policy definitions int...
Hi,I have an external table which reads data from a S3 bucket. The s3 bucket is expected to get new files frequently. With some changes to the underlying schema. I used Refresh Table table command to load new files from the s3 location and it worked ...
I want to run SQL statements whenever we add ROW FILTER or MASK using ALTER TABLE command. https://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-ddl-alter-table.htmlhttps://docs.databricks.com/en/sql/language-manual/sql-ref-syntax-ddl-alt...
The best way to run a jobon ALTER TABLE SET ROW FILTER or SET MASK.1. **Create the Function** You need to start by creating a function that will be used to filter the rows or mask the columns. The function should return a boolean value that determin...
Hi, The Catalog Explorer UI is not live in all Databricks workspaces. For information about the previous UI, see Explore and create tables in DBFS. Refer: https://docs.databricks.com/en/catalog-explorer/index.html .
Also, could you please share the ...
we are planning to enabled azure private link config. as per article looks , we will have 2 private link services that need to be configured and 2 private endpoints. also we would like enable system tables. based on system tables limitations it says ...
Hi, In this scenario, are you mentioning about private preview of system tables? Also, you can refer to https://learn.microsoft.com/en-us/azure/key-vault/general/integrate-databricks-blob-storage , let us know if this helps.
I’m currently trying to create a Foreign Catalog based on a Connection object of type SQLSERVER. This would allow me to directly access our on-premises MS SQL database from within Azure Databricks using Unity Catalog.As I’m part of a large organizati...
Hi @MiroFuoli, Firstly, ensuring you’re using the correct versions of dbt-core and dbt-databricks is important. There have been instances where specific versions of these packages have caused issues. You might want to try using an older version, such...
We have a requirement to configure storage credentials in UC for s3 buckets which have been previously mounted by using access keys mounts has been depreciated and we need to configure storage credentials when we use UC. But while configuring storag...
Thank you for posting your question in our community! We are happy to assist you.To help us provide you with the most accurate information, could you please take a moment to review the responses and select the one that best answers your question?This...
Good afternoon,We are in the process of setting up Unity Cat, we started in our existing workspace and set it up fine. We are particularly interested in federating existing warehouses at this point. We were able to federate one datawarehouse (dwh1) b...
