cancel
Showing results for 
Search instead for 
Did you mean: 
Data Governance
Join discussions on data governance practices, compliance, and security within the Databricks Community. Exchange strategies and insights to ensure data integrity and regulatory compliance.
cancel
Showing results for 
Search instead for 
Did you mean: 
Data + AI Summit 2024 - Data Governance

Forum Posts

aegisbot
by New Contributor II
  • 3166 Views
  • 2 replies
  • 3 kudos

Resolved! User Access tokens are disabled.

I have the administrator role, but I can't find where in the interface to enable access tokens. I created a single workspace. I haven't created a unity catalog or anything yet. Please advice. As well is there any best practice documentation on creati...

  • 3166 Views
  • 2 replies
  • 3 kudos
Latest Reply
Rishabh-Pandey
Honored Contributor II
  • 3 kudos

hey @Roberto Martin​  acess token will be generated by the admin only , as you have the admin access , then open your workspace see the right side there is the option of user settings click on that you will get another window , from where we can crea...

  • 3 kudos
1 More Replies
amitca71
by Contributor II
  • 3105 Views
  • 5 replies
  • 2 kudos

external location on unity catalog permits access to s3

Hi,when i create external location on unity catalog. even if i dont provide any user grants, i have an write access to the s3 bucket from attached workspace.i created external location xxxxi didnt allow any permissions on it on a workspace that is co...

  • 3105 Views
  • 5 replies
  • 2 kudos
Latest Reply
Sivaprasad1
Valued Contributor II
  • 2 kudos

@Amit Cahanovich​ : Could you please share your config details,Which DBR version ?Cluster has any instance profile?

  • 2 kudos
4 More Replies
RicksDB
by Contributor II
  • 2813 Views
  • 5 replies
  • 5 kudos

DLT and Unity catalog best practices

What are the best practices when using DLT with a unity catalog aware workspace since it is not supported at the moment?Do you create a copy of every table you need in the hive metastore in order to reference them? Or is it recommended to wait until ...

  • 2813 Views
  • 5 replies
  • 5 kudos
Latest Reply
Andrij_D
New Contributor II
  • 5 kudos

Hi @E H​ , the best way to manage this for the time being is to limit DLT to logic that is considered 'internal' i.e., leveraging the default hive metastore. For now at least, this should be treated as a transient landing zone. From here you can refi...

  • 5 kudos
4 More Replies
espenol
by New Contributor III
  • 2480 Views
  • 2 replies
  • 6 kudos

Unable to write structured streaming

Without streaming everything works fine. When I try to set up some example structured streaming in my company's new Databricks workspace (we're trying it out) I can't seem to figure out the correct way to save it/write to storage. Please see the pict...

code and error message
  • 2480 Views
  • 2 replies
  • 6 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 6 kudos

Hi, This can be an issue where Storage Blob Data contributor role is missing. Please refer: https://docs.databricks.com/external-data/azure-storage.html

  • 6 kudos
1 More Replies
viSual
by New Contributor II
  • 768 Views
  • 1 replies
  • 2 kudos

AWS Unity Catalog S3 Bucket Security

Hi,I've got Unity Catalog working but i cant create an external Table.We have several Workspaces (with customer managed VPCs), all with Private Link connected to the Control Plane. Our Data S3 Buckets are secured via Bucket Policy (in addition to KM...

  • 768 Views
  • 1 replies
  • 2 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 2 kudos

Hi, Could you please confirm if you have followed this: https://docs.databricks.com/data-governance/unity-catalog/get-started.html , also, please confirm the exact error received?

  • 2 kudos
ThibDulh_4634
by New Contributor II
  • 688 Views
  • 1 replies
  • 2 kudos

Transfer metastore ownership, not able to create catalogs

Hi there,I am facing an issue when setting up the metastore.I use an account admin user, and the user is part of a group called Unity admin.The Unity admin group contains 2 users: me and another user, also account admin.Without Unity catalog, for now...

  • 688 Views
  • 1 replies
  • 2 kudos
Latest Reply
Debayan
Esteemed Contributor III
  • 2 kudos

Hi, Could you please refer https://docs.databricks.com/data-governance/unity-catalog/manage-privileges/index.html#transfer-ownership, please let us know if this helps.

  • 2 kudos
kmehkeri
by New Contributor III
  • 11486 Views
  • 6 replies
  • 6 kudos

Resolved! DBFS mounts no longer recommended?

Checking the docs I noticed this statement under Azure storage access page:[https://learn.microsoft.com/en-us/azure/databricks/external-data/azure-storage]Deprecated patterns for storing and accessing data from Azure DatabricksThe following are depre...

  • 11486 Views
  • 6 replies
  • 6 kudos
Latest Reply
Jfoxyyc
Valued Contributor
  • 6 kudos

You don't need to mount to dbfs. The security issue with mounting is that as soon as you've mounted using a credential, everyone with access to the workspace now has access to the data at that mounted location.The recommended way that isn't mounting ...

  • 6 kudos
5 More Replies
User16345769212
by New Contributor III
  • 1201 Views
  • 3 replies
  • 5 kudos

Unity Catalog and Delta Sharing Workshop - Register Now! Join us on February 2nd, 2023 as we take Unity Catalog for a spin. Register Here!! Unity Cata...

Unity Catalog and Delta Sharing Workshop - Register Now!Join us on February 2nd, 2023 as we take Unity Catalog for a spin. Register Here!!Unity Catalog provides a unified governance solution for data, analytics and AI on any cloud. With Unity Catalog...

2022-12-Unity-Catalog-Delta-Sharing-Workshop-email-Banner-600x220-2x
  • 1201 Views
  • 3 replies
  • 5 kudos
Latest Reply
jose_gonzalez
Moderator
  • 5 kudos

Great session. Thank you for sharing

  • 5 kudos
2 More Replies
Aviral-Bhardwaj
by Esteemed Contributor III
  • 2342 Views
  • 2 replies
  • 33 kudos

Unity Catalog Understanding In Databricks The Unity Catalog is a feature of the Databricks platform that allows users to organize and discover data as...

Unity Catalog Understanding In DatabricksThe Unity Catalog is a feature of the Databricks platform that allows users to organize and discover data assets within their organization. It provides a central repository for storing and managing data assets...

  • 2342 Views
  • 2 replies
  • 33 kudos
Latest Reply
Meghala
Valued Contributor II
  • 33 kudos

This is very much usefull sir

  • 33 kudos
1 More Replies
Aviral-Bhardwaj
by Esteemed Contributor III
  • 3873 Views
  • 2 replies
  • 37 kudos

Understanding DLT pipe lines in Databricks In Databricks, a DLT (Data Live Table) pipeline is a set of data transformations that are applied to data a...

Understanding DLT pipe lines in DatabricksIn Databricks, a DLT (Data Live Table) pipeline is a set of data transformations that are applied to data assets in a defined sequence, in order to clean, enrich, and prepare data for analysis or other purpos...

  • 3873 Views
  • 2 replies
  • 37 kudos
Latest Reply
Meghala
Valued Contributor II
  • 37 kudos

Im thanking @Aviral Bhardwaj​  for this kind of information

  • 37 kudos
1 More Replies
Carsten_K
by New Contributor III
  • 3558 Views
  • 9 replies
  • 6 kudos

Unity Catalog - great or limited?

Hi Guys,I'd like to know how you have adopted the Unity Catalog. To me it seems rather limited in terms of that you are only allowed to have one UC per region. We are building out a data warehouse and we have three workspaces - dev, test and prod. Th...

  • 3558 Views
  • 9 replies
  • 6 kudos
Latest Reply
Pat
Honored Contributor III
  • 6 kudos

Hi @Carsten Klausman​ ,How is your journey with the Unity Catalog?I am seeing more and more limitations recently. It's pity, we had this freedom to work with Spark - ACID and optimized.We are being forced to do things with the Unity Catalog, and seas...

  • 6 kudos
8 More Replies
Matt101122
by Contributor
  • 2094 Views
  • 2 replies
  • 9 kudos

Resolved! Unity Catalog Setup: Why must the first Azure Databricks account admin must be an Azure Active Directory Global Administrator at the time that they first log in to the Azure Databricks account console?

We are attempting to setup Unity Catalog and our security team is requesting justification on why this level of access is required. Why must the first Azure Databricks account admin must be an Azure Active Directory Global Administrator at the time t...

  • 2094 Views
  • 2 replies
  • 9 kudos
Latest Reply
LandanG
Honored Contributor
  • 9 kudos

Hi @Matthew Dalesio​ From our eng. team:"The high privileged is only used to make sure only highly privileged users get access to Databricks account admin role as this is a highly-privileged role and they can make anyone else an account admin. This i...

  • 9 kudos
1 More Replies
-werners-
by Esteemed Contributor III
  • 3422 Views
  • 6 replies
  • 20 kudos

Resolved! Unity catalog: separate workspace or not?

Now that Unity Catalog is GA, I was wondering how y'all implemented it (or planning to do so) on a workspace level.Do you create a separate 'one workspace to rule them all' with the Unity Catalog, or do you create it on an already existing workspace ...

  • 3422 Views
  • 6 replies
  • 20 kudos
Latest Reply
Pat
Honored Contributor III
  • 20 kudos

Are you thinking about creating totally separate workspace just to manage Unity Catalog?I've been playing a bit with the Unity Catalog and I am currently thinking about managing it from one of the existing workspaces. I don't think there is need for ...

  • 20 kudos
5 More Replies
karthik_p
by Esteemed Contributor
  • 895 Views
  • 1 replies
  • 5 kudos

upgrading external table to unity catalog failing with below error

Is any one came across below issue, based on azure external table upgrade article. what ever tables are being supported in unity catalog they can get upgraded. but other than below "UNSUPPORTED_FILE_SCHEME" Indication, we are not seeing much informat...

  • 895 Views
  • 1 replies
  • 5 kudos
Latest Reply
Ajay-Pandey
Esteemed Contributor III
  • 5 kudos

Hi @karthik p​ you can raise a support request to databricks they will let you know the limitation of this.You can use the below link for general QnA-Link

  • 5 kudos
Gilg
by Contributor II
  • 1196 Views
  • 2 replies
  • 0 kudos

Delta Sharing within the same region

Hi Team,I have setup UC and have a Metastore for AUE. Assigned 2 workspaces to the AUE Metastore and both with different set of users and group . 1 workspace is the data provider and the other is a data consumerNow since 2 workspaces are in one Meta...

  • 1196 Views
  • 2 replies
  • 0 kudos
Latest Reply
youssefmrini
Honored Contributor III
  • 0 kudos

If the two Workspaces are under the same metastore you don't need Delta Sharing because they already have access to the same data. Unless you want to do data segregation per workspace. if it's the case it's coming soon at the end of february

  • 0 kudos
1 More Replies
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels