cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Help
Get Started Discussions
Start your journey with Databricks by joining discussions on getting started guides, tutorials, and introductory topics. Connect with beginners and experts alike to kickstart your Databricks experience.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Start a conversation
Phani1
by • Valued Contributor
  • 558 Views
  • 2 replies
  • 0 kudos

Data masking best practices

Hi Team,Could you please suggest any best practices/blogs on implementing data masking, row level ,column level ,access control, role-based access control (RBAC), and attribute-based access control (ABAC)?  Regards.Phanindra

Get Started Discussions
Reply
  • 558 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hey there! Thanks a bunch for being part of our awesome community!  We love having you around and appreciate all your questions. Take a moment to check out the responses – you'll find some great info. Your input is valuable, so pick the best solution...

  • 0 kudos
1 More Replies
Phani1
by • Valued Contributor
  • 882 Views
  • 4 replies
  • 0 kudos

Autoloader file latency

Hi Team,I would like to understand if there is a metadata table for the autoloader in Databricks that captures information about file arrival and processing.The reason we are experiencing data issues is because our table A receives hundreds of files ...

Get Started Discussions
Reply
  • 882 Views
  • 4 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hey there! Thanks a bunch for being part of our awesome community!  We love having you around and appreciate all your questions. Take a moment to check out the responses – you'll find some great info. Your input is valuable, so pick the best solution...

  • 0 kudos
3 More Replies
Phani1
by • Valued Contributor
  • 2769 Views
  • 1 replies
  • 0 kudos

RBAC

Hi Team,can provide you with step-by-step instructions on how to create role-based access and attribute-based access in Databricks.Regards,Phanindra

Get Started Discussions
Reply
  • 2769 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Phani1, Here’s how you can set them up:   Role-Based Access Control (RBAC): Overview: RBAC allows you to define roles and assign permissions to users, groups, or service principals. These roles determine what actions users can perform within Da...

  • 0 kudos
ChristianRRL
by • Contributor II
  • 934 Views
  • 1 replies
  • 1 kudos

Resolved! Unity Catalog: Databricks *Specific* Features

Good day,Deceptively simple question, are there any "Databricks only" specific features that Unity Catalog offers? I understand that generally speaking enabling UC offers some of the following:Data Discovery and LineageAuditing and MonitoringAccess C...

Get Started Discussions
Reply
  • 934 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @ChristianRRL,  Unity Catalog is a powerful governance solution for data and AI assets within the Databricks lakehouse.    Let’s delve into its key features and explore how it differs from other tools:   Define Once, Secure Everywhere: Unity Catal...

  • 1 kudos
AbdurRehman
by • New Contributor
  • 309 Views
  • 1 replies
  • 0 kudos

Error Signing Up for Databricks Community Edition

@Kaniz_Fatma I've been trying to sign up for Databricks Community Edition using different email addresses over the past 24 hours, but I keep getting the error message: "An error has occurred. Please try again later." Can anyone help?Tags: #Databricks...

Get Started Discussions
Reply
  • 309 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @AbdurRehman, Please look at this link related to the Community - Edition, which might solve your problem.   I appreciate your interest in sharing your Community-Edition query with us.   If you have any more questions or concerns, please don't hes...

  • 0 kudos
Kris2
by • New Contributor II
  • 1111 Views
  • 1 replies
  • 0 kudos

Resolved! Unable to create a Managed table in Unity Catalog defaul location

We have setup the metastore with Manged Identity and when trying to create a managed table in the default location I am hitting below error. The storage is ADLS Gen2. AbfsRestOperationException: Operation failed: "This request is not authorized to pe...

Get Started Discussions
Reply
  • 1111 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Ayushi_Suthar
Honored Contributor
  • 0 kudos

Hi @Kris2 , I completely understand your hesitation and appreciate your approach to seeking guidance!  This error generally means that the cluster has connectivity to Unity Catalog configured storage location and it is not authorized to access storag...

  • 0 kudos
CMA
by • New Contributor II
  • 3014 Views
  • 2 replies
  • 0 kudos

Problem login in

Hello allI´m new in this platform, I sign up, validated my email, create my password everything is fine and when I try to log in and start a message came upI create a new password but same happen again! But it works a few times, I think like 3 times....

CMA_0-1706923323303.png
Get Started Discussions
Reply
  • 3014 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Walter_C
Honored Contributor
  • 0 kudos

Can you confirm the username was created all lower case? Login is case sensitive so you need to make sure the username is set same exact as you add it in the console or workspace

  • 0 kudos
1 More Replies
shrutigupta12
by • New Contributor II
  • 1263 Views
  • 3 replies
  • 0 kudos

Resolved! DataBricks Certification Exam Got Suspended. Require Immediate support

Hello @Cert-Team  @Certificate Team,Request Id# 00432042I encountered a pathetic experience while attempting my Databricks Certified Data Engineer Professional certification exam. This is a completely unethical process to harass the examinee and lose...

Get Started Discussions
Reply
  • 1263 Views
  • 3 replies
  • 0 kudos
View Replies
Latest Reply
Cert-Team
Honored Contributor III
  • 0 kudos

@shrutigupta12 I'm sorry to see you had difficulty with your video feed. Glad to see the proctor was able to help resolve the issue and you were able to complete your exam. 

  • 0 kudos
2 More Replies
Databricks_Java
by • New Contributor
  • 1003 Views
  • 1 replies
  • 0 kudos

Databricks Java - Create Jar in Java 11

I am trying to a run simple print java program which is not working and getting compilation version issues though i changed the environment variable points to java 11. Can you please help me ? Can we create java with spark session and execute as a ja...

Get Started Discussions
Databricks
env
jar
java
spark
Reply
  • 1003 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
arpit
Valued Contributor
  • 0 kudos

@Databricks_Java You can run command like this: spark-submit --class com.test.Main example.jarand make sure to check the java version and match with the DBR compatibility

  • 0 kudos
mathijs-fish
by • New Contributor III
  • 551 Views
  • 1 replies
  • 0 kudos

Disable personal compute with the Databricks API or UI

For a production environment, I want to disable the personal compute policy, because I do not want that all users can create personal compute clusters in production. Unfortunately, I am not able to access the account console, so I want to revoke perm...

mathijsfish_0-1702396352437.png mathijsfish_1-1702396390529.png
Get Started Discussions
compute
permissions
policies
Reply
  • 551 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
arpit
Valued Contributor
  • 0 kudos

@mathijs-fish You need to be admin to disable a policy.

  • 0 kudos
Data_Engineer3
by • Contributor II
  • 2089 Views
  • 2 replies
  • 0 kudos

Resolved! spark context in databricks

Hi @all,In Azure Databricks,I am using structured streaming for each batch functionality, in one of the functions I am creating tempview with pyspark dataframe (*Not GlobalTempView) and trying to access the same temp view by using spark.sql functiona...

Get Started Discussions
Databricks
Reply
  • 2089 Views
  • 2 replies
  • 0 kudos
View Replies
Latest Reply
Lakshay
Esteemed Contributor
  • 0 kudos

Do you face this issue without spark streaming as well? Also, could you share a minimal repo code preferably without streaming?

  • 0 kudos
1 More Replies
Phani1
by • Valued Contributor
  • 524 Views
  • 1 replies
  • 0 kudos

Data Masking issue

Hi Team,After successfully creating a group and populating it with members, I am facing the problem of the is_member() function always returning False, despite the user being part of the group. This issue is specific to my sandbox Databricks Account....

Get Started Discussions
Datamasking
Reply
  • 524 Views
  • 1 replies
  • 0 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Phani1, The is_member() function you’re referring to seems to be specific to your application or codebase, as it’s not a built-in function in Databricks or associated with the Unity Catalog.   If you’re facing an issue where is_member() is always...

  • 0 kudos
Arch_dbxlearner
by • New Contributor III
  • 6135 Views
  • 10 replies
  • 5 kudos

What are the different ways to pull the log data from Splunk to Databricks?

Hi,I have recently started Splunk Integration with Databricks. Basically I am trying to ingest the data from Splunk to Databricks. I have gone through the documentation regarding Splunk Integration. There are some basic information about the integrat...

Get Started Discussions
Reply
  • 6135 Views
  • 10 replies
  • 5 kudos
View Replies
Latest Reply
Arch_dbxlearner
New Contributor III
  • 5 kudos

@Kaniz_Fatma You have mentioned that Databricks Add-on for Splunk, is bidirectional. Do we need to install this app on Databricks itself, to fetch the data from Splunk?I tried to check this add-on on Databricks Marketplace but I could not find this. ...

  • 5 kudos
9 More Replies
ChristianRRL
by • Contributor II
  • 1368 Views
  • 4 replies
  • 2 kudos

Purpose of DLT Table table_properties > quality:medallion

Hi there, silly question here but can anyone help me understand what practical purpose does labelling the table_properties with "quality":"<specific_medallion>"? For example: @Dlt.table( comment="Bronze live streaming table for Test data", name="...

Get Started Discussions
Reply
  • 1368 Views
  • 4 replies
  • 2 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 2 kudos

@ChristianRRL, Welcome, and thank you for being a part of our community! We highly value your inquiries, and we applaud your active participation. We kindly invite you to take some time to review the responses provided and select the solution that be...

  • 2 kudos
3 More Replies
Phani1
by • Valued Contributor
  • 420 Views
  • 1 replies
  • 1 kudos

feasibility of using user groups

Hi Team,Can you provide me the details of feasibility of using user groups for granting access to both Personally Identifiable Information (PII) and Non-PII in SQL PoolsRegards,Phanindra

Get Started Discussions
user groups
Reply
  • 420 Views
  • 1 replies
  • 1 kudos
View Replies
Latest Reply
Kaniz_Fatma
Community Manager
  • 1 kudos

Hi @Phani1, Yes, it is feasible to use user groups for granting access to both Personally Identifiable Information (PII) and Non-Personally Identifiable Information (Non-PII) in SQL Pools.    Here are some key points to consider:   PII and Non-PII: P...

  • 1 kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!

Labels
Top Kudoed Authors
View all