cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

vabadzhiev
by New Contributor II
  • 967 Views
  • 2 replies
  • 0 kudos

Tableau Prep Save Output to Databricks

Has anyone run into use cases where your data scientist/data engineer end users build Tableau Prep Flows and steps in Tableau Prep Flow require saving output back into Databricks? There appears to be no native support for this in Tableau Prep if the ...

  • 967 Views
  • 2 replies
  • 0 kudos
Latest Reply
vabadzhiev
New Contributor II
  • 0 kudos

These are awesome suggestions. To expand on our setup, we also have Informatica Cloud - IICS (CMI, CDI, etc.) connected to the entire setup generally used for bringing data from a source (PaaS, SaaS, On-prem SQL, Flat Files or streaming devices) to D...

  • 0 kudos
1 More Replies
kazinahian
by New Contributor III
  • 7111 Views
  • 3 replies
  • 1 kudos

Seeking Tips: Ways to Master Databricks on Azure?

Hello everyone. I'm currently learning Databricks on Azure through a Udemy course. Recently, I was surprised by a charge of $86 from Azure, which has made me cautious about continuing in this manner. Is there a more cost-effective approach to learn D...

  • 7111 Views
  • 3 replies
  • 1 kudos
Latest Reply
LauraMurphy
New Contributor II
  • 1 kudos

Thank you so much for the information.

  • 1 kudos
2 More Replies
samarth10
by New Contributor II
  • 386 Views
  • 1 replies
  • 0 kudos

Assigning a group as USER to service principal

How can we assigning a group as USER to service principal using databricks-sdk, this is not supported?

  • 386 Views
  • 1 replies
  • 0 kudos
Latest Reply
samarth10
New Contributor II
  • 0 kudos

I found this API, https://docs.databricks.com/api/account/accountaccesscontrol/updaterulesetbut its PUT and GET method both requires a parameter "etag", how can someone know this "etag"?

  • 0 kudos
Avvar2022
by Contributor
  • 2990 Views
  • 6 replies
  • 2 kudos

Unity catalog enabled workspace -Is there any way to disable workflow/job creation for certain users

Currently in unity catalog enabled workspace users with "Workspace access" can create workflows/jobs, there is no access control available to restrict users from creating jobs/workflows.Use case: In production there is no need for users, data enginee...

  • 2990 Views
  • 6 replies
  • 2 kudos
Latest Reply
Avvar2022
Contributor
  • 2 kudos

not being able to restrict creation of workflows/jobs, alerts, dashboards make platform admin job difficult to keep system clean and control cost. there is no need for data engineers to create a workflow in production. there is no need for all users ...

  • 2 kudos
5 More Replies
Henrik
by New Contributor III
  • 783 Views
  • 3 replies
  • 0 kudos

List granted access for a group or a user

Is there any way where I can see what access a group or a user have been given to objects (Tables, views, catalogs etc.)?I noticed that we have the following information_schema tables:catalog_privilegesroutine_privilegestable_privilegesschema_privile...

  • 783 Views
  • 3 replies
  • 0 kudos
Latest Reply
anardinelli
Esteemed Contributor III
  • 0 kudos

Hi @Henrik  To grant a user the privilege to query system tables, a metastore admin or another privileged user must grant USE and SELECT permissions on the system schemas.   GRANT USAGE ON CATALOG system TO <user_name>; GRANT USAGE ON SCHEMA informa...

  • 0 kudos
2 More Replies
Kasen
by New Contributor III
  • 541 Views
  • 1 replies
  • 0 kudos

Materialized view in DLT pipeline

When setting up DLT pipeline, there are 3 types of product edition, Core, Pro and Advanced. When I compare DLT Classic Core and DLT Classic Pro, the difference is that DLT Classic Pro can handle CDC. Does it means if I'm using DLT Classic Core, I hav...

Community Platform Discussions
DLT pipeline
Materialized view
  • 541 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kasen
New Contributor III
  • 0 kudos

Also, If I'm using DLT Classic Core for DLT pipeline, the materialized view will be doing a full refresh or just update on the rows that have changes? 

  • 0 kudos
SHASHANK2
by New Contributor III
  • 1030 Views
  • 3 replies
  • 1 kudos

Resolved! Test has been suspended

Hello guys,I was taking test for data bricks data analyst associate and irrespective of any solid reason they have suspended my test. saying i am not giving eyecontact to camera. how can i read questions and options while eyecontacting with camera. I...

  • 1030 Views
  • 3 replies
  • 1 kudos
Latest Reply
SHASHANK2
New Contributor III
  • 1 kudos

@Cert-TeamOPS Thanks for you timely support, my issue has been cleared. my test has been rescheduled to the time I have asked. I am very grateful for your responses.Thanks and Regards@SHASHANK2 

  • 1 kudos
2 More Replies
young_sheldon
by New Contributor
  • 532 Views
  • 1 replies
  • 0 kudos

How to optimize a View ?

I have create a view from my underlying delta live table. Generally delta live table get auto optimize with vaccum in place. If thats so why do my view take 1 hour to be queried ? Any other way to optimize it ?

  • 532 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @young_sheldon,  Ensure that your table is properly partitioned and clustered. Partitioning by relevant columns (such as device_id) can significantly speed up queries and reduce data shuffling during reads.Clustering the data based on frequently a...

  • 0 kudos
SHASHANK2
by New Contributor III
  • 1174 Views
  • 4 replies
  • 2 kudos

Resolved! About resuming the test - [ ref:_00D61JGc4._500Vp6jMk5:ref ]

Hello @Cert-Team I am very glad to hear from you,in response of the ticket (00481969), I have received mail for rescheduling of my test to resume. I am very thankful for your quick response in this matter.I have replied in mail about the date and tim...

  • 1174 Views
  • 4 replies
  • 2 kudos
Latest Reply
SHASHANK2
New Contributor III
  • 2 kudos

@Cert-Team, My issue has been clear. my test has been rescheduled to the time I have mentioned.I am very grateful for your help.Thanks and Regards@SHASHANK2 

  • 2 kudos
3 More Replies
aarshps
by New Contributor
  • 696 Views
  • 2 replies
  • 0 kudos

Microsoft PNP Azure Log Analytics

There is this com.microsoft.pnp.Util package that is used inside my Scala notebook used for Azure Databricks to Azure Log Monitoring tables push for my application logs. When I updated my Databricks Runtime from 10.4 to 14 in my clusters, it starts t...

  • 696 Views
  • 2 replies
  • 0 kudos
Latest Reply
NandiniN
Esteemed Contributor III
  • 0 kudos

Hi @aarshps , How were you installing the library for the package com.microsoft.pnp.Util? Was it a library, whl, init script etc?

  • 0 kudos
1 More Replies
Mehdi-LAMRANI
by New Contributor II
  • 664 Views
  • 2 replies
  • 0 kudos

REST API call throwing 403

Hi,  Calling curl works just fine from my workspace ```` %sh curl --request GET "https://${DATABRICKS_HOST}/api/2.0/clusters/list" --header "Authorization: Bearer ${DATABRICKS_API_TOKEN}"```But when I transpose the same logic to a script in javascrip...

  • 664 Views
  • 2 replies
  • 0 kudos
Latest Reply
NandiniN
Esteemed Contributor III
  • 0 kudos

Thanks for sharing your findings, you can archive the ticket from Options on the right hand side.  

  • 0 kudos
1 More Replies
baricado
by New Contributor
  • 841 Views
  • 2 replies
  • 1 kudos

How to Determine Which CLI Methods to Use?

The Databricks CLI is considered Legacy for versions below 0.17 and is in Public Preview for versions above 0.20. I have access to documentation for both these versions separately. As I am developing a new project, I prefer not to use legacy options ...

  • 841 Views
  • 2 replies
  • 1 kudos
Latest Reply
NandiniN
Esteemed Contributor III
  • 1 kudos

While the legacy CLI (versions 0.18 and below) is still available, it is not receiving any non-critical updates and it is recommend migrating to the new CLI as soon as possible. "Databricks recommends that you use Databricks CLI version 0.205 or abov...

  • 1 kudos
1 More Replies
MSD
by New Contributor
  • 806 Views
  • 1 replies
  • 0 kudos

Community version now shows only the MLpersona

hiI have been using the community version for sometime and had saved some notebooks. While the notebooks are there in the workspace the different personas are not available as seen today. Only machine learning persona is visible.  Would like to check...

  • 806 Views
  • 1 replies
  • 0 kudos
Latest Reply
NandiniN
Esteemed Contributor III
  • 0 kudos

Hi MSD,  We removed the different personas that was observed earlier and now it is a flat system (It is not a recent change, been there for sometime). The notebooks would be saved in your workspace hence they are accessible. Irrespective of the perso...

  • 0 kudos
Mehdi-LAMRANI
by New Contributor II
  • 934 Views
  • 1 replies
  • 0 kudos

SQL Statement Execution API w/ Javascript (REST)

I need to use Databricks SQL Statement Execution API w/ Javascript (see example post )For some reason, Curl Works, Python works, but Javascript fails.This works : (curl)______________________________curl --request POST \https://adb-5750xxxxxxx.azured...

  • 934 Views
  • 1 replies
  • 0 kudos
Latest Reply
Kaniz_Fatma
Community Manager
  • 0 kudos

Hi @Mehdi-LAMRANI,  Ensure that your JavaScript code is being executed from a domain that is allowed to make requests to the Databricks API. If the JavaScript code is running in a different domain (e.g., a local file), you might encounter CORS issues...

  • 0 kudos

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors