SpoilerWe have a UC enabled on Databricks where we have two Metastores,Metastore in West Europe regionMetastore in North America regionAnd Databricks workspace.Workspace in West Europe regionAnd we want to have a single Databricks workspace for both ...
Hello community !Here's my problem : I had a workspace with Unity Catalog enabled, and a catalog stored on an external location (Azure storage account). All my schemas and tables were storage on this storage. However we recently deleted the metastore...
If both the Catalog and the Schema and tables are stored externally, and you have deleted the original catalog, you should be able to recreate the schema in a new catalog by pointing it to the previous data files and running the SYNC command. Here ar...
Hello,I would like to know if there is direct access to the Databricks query history tables. For compliance issues, I would like to be able to create reports for something like: who has accessed a particular column in a table in the past 6 months. T...
Hi,I'm currently using Unity Catalog and serving as the metastore admin. However, I've encountered an issue where I cannot select the "Enable Delta sharing to allow a Databricks user to share data outside their organization" checkbox as it appears to...
@jpaladini - could you please let us know if you had a chance to follow the steps to setup Delta Sharing on your workspace - https://docs.databricks.com/en/data-sharing/set-up.html#enable-delta-sharing-for-your-account?
I want to load a Keras model using abfss. As far as I know, this is not possible, and the only way of doing this is by copying the model from ADLS to dbfs.I am concerned about the data governance, as everybody could potentionally modify/delete the mo...
Hi @Kaniz,Can you please elaborate on these or share related documentation?Use Access Control Lists (ACLs) or Shared Access Signatures (SAS) to restrict access further.Is it possible to use ACLs to control DBFS access?Serialize your Keras model (arch...
FileNotFoundError: [Errno 2] No such file or directory: '/dbfs/FileStore/config.share'When I am trying to read the config.share file, it is throwing this error. I tried with spark path format as well which is dbfs:/FileStore/config.share' but it also...
we are switching over to Unity Catalog and attempting to confirm the ability to run our existing notebooks. I have created a new Shared Unity Catalog Cluster and ran the notebook using the new cluster. Ran into an error attempting to execute a prin...
I faced the same issue when switching to Shared Access cluster and found that there is a possibility to run :dbutils.notebook.entry_point.getDbutils().notebook().getContext().safeToJson()Hope this helps
Databricks autocomplete is checking the hive_metastore catalog when I enter the schema_name and table_name in the notebook although we have other default catalog set at the workspace level. How to make Databricks autocomplete use that catalog when en...
Hi @Kaniz ! Thanks for your answer. I forgot to mention that we already have this set up at the cluster level (using spark.databricks.sql.initial.catalog.name variable) besides setting this on the workspace level in the workspace settings but none of...
Hi all,Since the last update of Databricks (21.03.2024), I can't find the option to git reset my repo anymore. Where did it go?Thanks in advance for your guidance!
Hello Briksters, i am looking for a giving a grand to developer being able execute with SHOW GROUPS WITH USER '***@***' without admin permission on UC.Could you give any tips to do it? UC Admin is able to see result query, but developer is not.
Thank you for your comprehensive answer.I assume from what you have written that this cannot be done without admin permissions on the metastore.So is there any other way to check who is in which group?
I have tried different browsers and deleting cache despite that I am seeing this giant logo of databricks on the workspace home page and multiple people in our org are having this issue.
Hi,We are rolling out Unity in our organization and while playing around I had set some tags on a test catalog.After removing this catalog, the tag keys I used are still present in our Unity environment and I am unable to find where they are stored t...
I have run into an issue with creating an External Location on an ASLS storage container with the following error :"Hierarchical Namespace (HNS) not enabledAzure storage account does not have hierarchical namespace (HNS) enabled." The Storage accoun...
Hi @rkalluri-apex,
Ensure that HNS is indeed enabled on your upgraded ADLS Gen2 storage account. Sometimes, even after upgrading, the setting might not take effect immediately.Verify that there are no conflicting configurations or issues specific to...
I'm trying to use bamboolib on the 11.0 recommended DBR. I am using the option "Databricks: Load database table" The databases and tables that are on the unity catalog do not populate the dropdown boxes. How can I fix this?
Hello @k.b.​ Hope all is well! Just wanted to check in if you were able to resolve your issue and would you be happy to share the solution or mark an answer as best? Else please let us know if you need more help. We'd love to hear from you.Thanks!
We are looking to send messages using databricks to an azure service bus topic and would like to connect to the service bus using a managed identity vs a connection string. Is this possible in databricks. The only thing I could find regarding datab...
To be honest, the Databricks team sucks. They should add a simple Identity tab under the Databricks workspace resource as it is done for other Microsoft services. They don't think about making product easier to maintain and configure, they look from ...