cancel
Showing results for 
Search instead for 
Did you mean: 
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Phani1
by Valued Contributor
  • 606 Views
  • 2 replies
  • 0 kudos

Data masking best practices

Hi Team,Could you please suggest any best practices/blogs on implementing data masking, row level ,column level ,access control, role-based access control (RBAC), and attribute-based access control (ABAC)?  Regards.Phanindra

  • 606 Views
  • 2 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hey there! Thanks a bunch for being part of our awesome community!  We love having you around and appreciate all your questions. Take a moment to check out the responses – you'll find some great info. Your input is valuable, so pick the best solution...

  • 0 kudos
1 More Replies
Phani1
by Valued Contributor
  • 977 Views
  • 4 replies
  • 0 kudos

Autoloader file latency

Hi Team,I would like to understand if there is a metadata table for the autoloader in Databricks that captures information about file arrival and processing.The reason we are experiencing data issues is because our table A receives hundreds of files ...

  • 977 Views
  • 4 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hey there! Thanks a bunch for being part of our awesome community!  We love having you around and appreciate all your questions. Take a moment to check out the responses – you'll find some great info. Your input is valuable, so pick the best solution...

  • 0 kudos
3 More Replies
Phani1
by Valued Contributor
  • 3116 Views
  • 1 replies
  • 0 kudos

RBAC

Hi Team,can provide you with step-by-step instructions on how to create role-based access and attribute-based access in Databricks.Regards,Phanindra

  • 3116 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Phani1, Here’s how you can set them up:   Role-Based Access Control (RBAC): Overview: RBAC allows you to define roles and assign permissions to users, groups, or service principals. These roles determine what actions users can perform within Da...

  • 0 kudos
ChristianRRL
by Contributor II
  • 1046 Views
  • 1 replies
  • 1 kudos

Resolved! Unity Catalog: Databricks *Specific* Features

Good day,Deceptively simple question, are there any "Databricks only" specific features that Unity Catalog offers? I understand that generally speaking enabling UC offers some of the following:Data Discovery and LineageAuditing and MonitoringAccess C...

  • 1046 Views
  • 1 replies
  • 1 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @ChristianRRL,  Unity Catalog is a powerful governance solution for data and AI assets within the Databricks lakehouse.    Let’s delve into its key features and explore how it differs from other tools:   Define Once, Secure Everywhere: Unity Catal...

  • 1 kudos
AbdurRehman
by New Contributor
  • 332 Views
  • 1 replies
  • 0 kudos

Error Signing Up for Databricks Community Edition

@Kaniz_Fatma I've been trying to sign up for Databricks Community Edition using different email addresses over the past 24 hours, but I keep getting the error message: "An error has occurred. Please try again later." Can anyone help?Tags: #Databricks...

  • 332 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @AbdurRehman, Please look at this link related to the Community - Edition, which might solve your problem.   I appreciate your interest in sharing your Community-Edition query with us.   If you have any more questions or concerns, please don't hes...

  • 0 kudos
Kris2
by New Contributor II
  • 1187 Views
  • 1 replies
  • 0 kudos

Resolved! Unable to create a Managed table in Unity Catalog defaul location

We have setup the metastore with Manged Identity and when trying to create a managed table in the default location I am hitting below error. The storage is ADLS Gen2. AbfsRestOperationException: Operation failed: "This request is not authorized to pe...

  • 1187 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ayushi_Suthar
Honored Contributor
  • 0 kudos

Hi @Kris2 , I completely understand your hesitation and appreciate your approach to seeking guidance!  This error generally means that the cluster has connectivity to Unity Catalog configured storage location and it is not authorized to access storag...

  • 0 kudos
CMA
by New Contributor II
  • 3069 Views
  • 2 replies
  • 0 kudos

Problem login in

Hello allI´m new in this platform, I sign up, validated my email, create my password everything is fine and when I try to log in and start a message came upI create a new password but same happen again! But it works a few times, I think like 3 times....

CMA_0-1706923323303.png
  • 3069 Views
  • 2 replies
  • 0 kudos
Latest Reply
Walter_C
Honored Contributor
  • 0 kudos

Can you confirm the username was created all lower case? Login is case sensitive so you need to make sure the username is set same exact as you add it in the console or workspace

  • 0 kudos
1 More Replies
shrutigupta12
by New Contributor II
  • 1390 Views
  • 3 replies
  • 0 kudos

Resolved! DataBricks Certification Exam Got Suspended. Require Immediate support

Hello @Cert-Team  @Certificate Team,Request Id# 00432042I encountered a pathetic experience while attempting my Databricks Certified Data Engineer Professional certification exam. This is a completely unethical process to harass the examinee and lose...

  • 1390 Views
  • 3 replies
  • 0 kudos
Latest Reply
Cert-Team
Honored Contributor III
  • 0 kudos

@shrutigupta12 I'm sorry to see you had difficulty with your video feed. Glad to see the proctor was able to help resolve the issue and you were able to complete your exam. 

  • 0 kudos
2 More Replies
Databricks_Java
by New Contributor
  • 1126 Views
  • 1 replies
  • 0 kudos

Databricks Java - Create Jar in Java 11

I am trying to a run simple print java program which is not working and getting compilation version issues though i changed the environment variable points to java 11. Can you please help me ? Can we create java with spark session and execute as a ja...

Get Started Discussions
Databricks
env
jar
java
spark
  • 1126 Views
  • 1 replies
  • 0 kudos
Latest Reply
arpit
Valued Contributor
  • 0 kudos

@Databricks_Java You can run command like this: spark-submit --class com.test.Main example.jarand make sure to check the java version and match with the DBR compatibility

  • 0 kudos
mathijs-fish
by New Contributor III
  • 592 Views
  • 1 replies
  • 0 kudos

Disable personal compute with the Databricks API or UI

For a production environment, I want to disable the personal compute policy, because I do not want that all users can create personal compute clusters in production. Unfortunately, I am not able to access the account console, so I want to revoke perm...

mathijsfish_0-1702396352437.png mathijsfish_1-1702396390529.png
Get Started Discussions
compute
permissions
policies
  • 592 Views
  • 1 replies
  • 0 kudos
Latest Reply
arpit
Valued Contributor
  • 0 kudos

@mathijs-fish You need to be admin to disable a policy.

  • 0 kudos
Data_Engineer3
by Contributor II
  • 2221 Views
  • 2 replies
  • 0 kudos

Resolved! spark context in databricks

Hi @all,In Azure Databricks,I am using structured streaming for each batch functionality, in one of the functions I am creating tempview with pyspark dataframe (*Not GlobalTempView) and trying to access the same temp view by using spark.sql functiona...

  • 2221 Views
  • 2 replies
  • 0 kudos
Latest Reply
Lakshay
Esteemed Contributor
  • 0 kudos

Do you face this issue without spark streaming as well? Also, could you share a minimal repo code preferably without streaming?

  • 0 kudos
1 More Replies
Phani1
by Valued Contributor
  • 575 Views
  • 1 replies
  • 0 kudos

Data Masking issue

Hi Team,After successfully creating a group and populating it with members, I am facing the problem of the is_member() function always returning False, despite the user being part of the group. This issue is specific to my sandbox Databricks Account....

  • 575 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Phani1, The is_member() function you’re referring to seems to be specific to your application or codebase, as it’s not a built-in function in Databricks or associated with the Unity Catalog.   If you’re facing an issue where is_member() is always...

  • 0 kudos
ChristianRRL
by Contributor II
  • 1706 Views
  • 4 replies
  • 2 kudos

Purpose of DLT Table table_properties > quality:medallion

Hi there, silly question here but can anyone help me understand what practical purpose does labelling the table_properties with "quality":"<specific_medallion>"? For example: @Dlt.table( comment="Bronze live streaming table for Test data", name="...

  • 1706 Views
  • 4 replies
  • 2 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 2 kudos

@ChristianRRL, Welcome, and thank you for being a part of our community! We highly value your inquiries, and we applaud your active participation. We kindly invite you to take some time to review the responses provided and select the solution that be...

  • 2 kudos
3 More Replies
Phani1
by Valued Contributor
  • 466 Views
  • 1 replies
  • 1 kudos

feasibility of using user groups

Hi Team,Can you provide me the details of feasibility of using user groups for granting access to both Personally Identifiable Information (PII) and Non-PII in SQL PoolsRegards,Phanindra

  • 466 Views
  • 1 replies
  • 1 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @Phani1, Yes, it is feasible to use user groups for granting access to both Personally Identifiable Information (PII) and Non-Personally Identifiable Information (Non-PII) in SQL Pools.    Here are some key points to consider:   PII and Non-PII: P...

  • 1 kudos
Phani1
by Valued Contributor
  • 479 Views
  • 1 replies
  • 1 kudos

end-to-end lineage using Unity Catalog

Hi Team,what is the Possibilities of getting end-to-end lineage using Unity CatalogRegards,Phanindra

  • 479 Views
  • 1 replies
  • 1 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @Phani1, Unity Catalog offers the possibility of capturing end-to-end data lineage across queries run on Azure Databricks.    Here are some key points:   Lineage Support: Lineage is supported for all languages and is captured down to the column le...

  • 1 kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels
Top Kudoed Authors