cancel
Showing results for 
Search instead for 
Did you mean: 
Community Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

Avvar2022
by Contributor
  • 1802 Views
  • 6 replies
  • 1 kudos

Unity catalog enabled workspace -Is there any way to disable workflow/job creation for certain users

Currently in unity catalog enabled workspace users with "Workspace access" can create workflows/jobs, there is no access control available to restrict users from creating jobs/workflows.Use case: In production there is no need for users, data enginee...

  • 1802 Views
  • 6 replies
  • 1 kudos
Latest Reply
Avvar2022
Contributor
  • 1 kudos

not being able to restrict creation of workflows/jobs, alerts, dashboards make platform admin job difficult to keep system clean and control cost. there is no need for data engineers to create a workflow in production. there is no need for all users ...

  • 1 kudos
5 More Replies
Henrik
by New Contributor III
  • 258 Views
  • 3 replies
  • 0 kudos

List granted access for a group or a user

Is there any way where I can see what access a group or a user have been given to objects (Tables, views, catalogs etc.)?I noticed that we have the following information_schema tables:catalog_privilegesroutine_privilegestable_privilegesschema_privile...

  • 258 Views
  • 3 replies
  • 0 kudos
Latest Reply
anardinelli
New Contributor III
  • 0 kudos

Hi @Henrik  To grant a user the privilege to query system tables, a metastore admin or another privileged user must grant USE and SELECT permissions on the system schemas.   GRANT USAGE ON CATALOG system TO <user_name>; GRANT USAGE ON SCHEMA informa...

  • 0 kudos
2 More Replies
Kasen
by New Contributor II
  • 176 Views
  • 1 replies
  • 0 kudos

Materialized view in DLT pipeline

When setting up DLT pipeline, there are 3 types of product edition, Core, Pro and Advanced. When I compare DLT Classic Core and DLT Classic Pro, the difference is that DLT Classic Pro can handle CDC. Does it means if I'm using DLT Classic Core, I hav...

Community Discussions
DLT pipeline
Materialized view
  • 176 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kasen
New Contributor II
  • 0 kudos

Also, If I'm using DLT Classic Core for DLT pipeline, the materialized view will be doing a full refresh or just update on the rows that have changes? 

  • 0 kudos
SHASHANK2
by New Contributor II
  • 433 Views
  • 3 replies
  • 1 kudos

Resolved! Test has been suspended

Hello guys,I was taking test for data bricks data analyst associate and irrespective of any solid reason they have suspended my test. saying i am not giving eyecontact to camera. how can i read questions and options while eyecontacting with camera. I...

  • 433 Views
  • 3 replies
  • 1 kudos
Latest Reply
SHASHANK2
New Contributor II
  • 1 kudos

@Cert-TeamOPS Thanks for you timely support, my issue has been cleared. my test has been rescheduled to the time I have asked. I am very grateful for your responses.Thanks and Regards@SHASHANK2 

  • 1 kudos
2 More Replies
young_sheldon
by New Contributor
  • 242 Views
  • 1 replies
  • 0 kudos

How to optimize a View ?

I have create a view from my underlying delta live table. Generally delta live table get auto optimize with vaccum in place. If thats so why do my view take 1 hour to be queried ? Any other way to optimize it ?

  • 242 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @young_sheldon,  Ensure that your table is properly partitioned and clustered. Partitioning by relevant columns (such as device_id) can significantly speed up queries and reduce data shuffling during reads.Clustering the data based on frequently a...

  • 0 kudos
SHASHANK2
by New Contributor II
  • 555 Views
  • 4 replies
  • 2 kudos

Resolved! About resuming the test - [ ref:_00D61JGc4._500Vp6jMk5:ref ]

Hello @Cert-Team I am very glad to hear from you,in response of the ticket (00481969), I have received mail for rescheduling of my test to resume. I am very thankful for your quick response in this matter.I have replied in mail about the date and tim...

  • 555 Views
  • 4 replies
  • 2 kudos
Latest Reply
SHASHANK2
New Contributor II
  • 2 kudos

@Cert-Team, My issue has been clear. my test has been rescheduled to the time I have mentioned.I am very grateful for your help.Thanks and Regards@SHASHANK2 

  • 2 kudos
3 More Replies
aarshps
by New Contributor
  • 240 Views
  • 2 replies
  • 0 kudos

Microsoft PNP Azure Log Analytics

There is this com.microsoft.pnp.Util package that is used inside my Scala notebook used for Azure Databricks to Azure Log Monitoring tables push for my application logs. When I updated my Databricks Runtime from 10.4 to 14 in my clusters, it starts t...

  • 240 Views
  • 2 replies
  • 0 kudos
Latest Reply
NandiniN
Honored Contributor
  • 0 kudos

Hi @aarshps , How were you installing the library for the package com.microsoft.pnp.Util? Was it a library, whl, init script etc?

  • 0 kudos
1 More Replies
Mehdi-LAMRANI
by New Contributor II
  • 268 Views
  • 2 replies
  • 0 kudos

REST API call throwing 403

Hi,  Calling curl works just fine from my workspace ```` %sh curl --request GET "https://${DATABRICKS_HOST}/api/2.0/clusters/list" --header "Authorization: Bearer ${DATABRICKS_API_TOKEN}"```But when I transpose the same logic to a script in javascrip...

  • 268 Views
  • 2 replies
  • 0 kudos
Latest Reply
NandiniN
Honored Contributor
  • 0 kudos

Thanks for sharing your findings, you can archive the ticket from Options on the right hand side.  

  • 0 kudos
1 More Replies
baricado
by New Contributor
  • 415 Views
  • 2 replies
  • 1 kudos

How to Determine Which CLI Methods to Use?

The Databricks CLI is considered Legacy for versions below 0.17 and is in Public Preview for versions above 0.20. I have access to documentation for both these versions separately. As I am developing a new project, I prefer not to use legacy options ...

  • 415 Views
  • 2 replies
  • 1 kudos
Latest Reply
NandiniN
Honored Contributor
  • 1 kudos

While the legacy CLI (versions 0.18 and below) is still available, it is not receiving any non-critical updates and it is recommend migrating to the new CLI as soon as possible. "Databricks recommends that you use Databricks CLI version 0.205 or abov...

  • 1 kudos
1 More Replies
MSD
by New Contributor
  • 227 Views
  • 1 replies
  • 0 kudos

Community version now shows only the MLpersona

hiI have been using the community version for sometime and had saved some notebooks. While the notebooks are there in the workspace the different personas are not available as seen today. Only machine learning persona is visible.  Would like to check...

Community Discussions
community edition
  • 227 Views
  • 1 replies
  • 0 kudos
Latest Reply
NandiniN
Honored Contributor
  • 0 kudos

Hi MSD,  We removed the different personas that was observed earlier and now it is a flat system (It is not a recent change, been there for sometime). The notebooks would be saved in your workspace hence they are accessible. Irrespective of the perso...

  • 0 kudos
Mehdi-LAMRANI
by New Contributor II
  • 411 Views
  • 1 replies
  • 0 kudos

SQL Statement Execution API w/ Javascript (REST)

I need to use Databricks SQL Statement Execution API w/ Javascript (see example post )For some reason, Curl Works, Python works, but Javascript fails.This works : (curl)______________________________curl --request POST \https://adb-5750xxxxxxx.azured...

  • 411 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Mehdi-LAMRANI,  Ensure that your JavaScript code is being executed from a domain that is allowed to make requests to the Databricks API. If the JavaScript code is running in a different domain (e.g., a local file), you might encounter CORS issues...

  • 0 kudos
hong
by New Contributor II
  • 2578 Views
  • 4 replies
  • 0 kudos

pytest error

Hello,I have a quick question. If my source code call pysark collect() or any method related to rdd methods, then pytest on my local PC will report the following error. My local machine doesn't have any specific setting for pyspark and I used findspa...

  • 2578 Views
  • 4 replies
  • 0 kudos
Latest Reply
hong
New Contributor II
  • 0 kudos

Thank you very much, brockb. Probably I will try it in databricks. Thanks.

  • 0 kudos
3 More Replies
shubbansal27
by New Contributor II
  • 5715 Views
  • 8 replies
  • 1 kudos

How to disable task in databricks job workflow

I don't see any option to disable the task. I have created one workflow which contains multiple tasks.sometime i need to disable some task for my experiment.  but there is no straightforward way for this.  I feel "disable" button is must have option ...

  • 5715 Views
  • 8 replies
  • 1 kudos
Latest Reply
Anonymous
Not applicable
  • 1 kudos

Hi @shubbansal27  We haven't heard from you since the last response from @Siebert_Looije , and I was checking back to see if her suggestions helped you. Or else, If you have any solution, please share it with the community, as it can be helpful to ot...

  • 1 kudos
7 More Replies
Nicu_Bordea
by New Contributor II
  • 396 Views
  • 1 replies
  • 0 kudos

Create a community user group Romania

Hello,I would like to receive some support in creating a Community User Group in Romania, Cluj-Napoca. Our intention as a company is to become a partner and us to create a community: events, meetups so on.Looking for your help.Thank youNicu

  • 396 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz
Community Manager
  • 0 kudos

Hi @Nicu_Bordea, Thank you for your interest in creating a new community user group for Romania. We appreciate your initiative. Our team will contact you shortly with more information and the next steps.

  • 0 kudos
Join 100K+ Data Experts: Register Now & Grow with Us!

Excited to expand your horizons with us? Click here to Register and begin your journey to success!

Already a member? Login and join your local regional user group! If there isn’t one near you, fill out this form and we’ll create one for you to join!