cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

barnita99
by New Contributor II
  • 19 Views
  • 2 replies
  • 0 kudos

No confirmation mail received after scheduling the exam

Hi team, I have scheduled my Databricks Data Engineer Associate exam for 12th Feb 2025 using the below mail id, but I still have not received any confirmation mail there. I have checked spam folder too.Could you please resend it to barnitac@kpmg.com ...

  • 19 Views
  • 2 replies
  • 0 kudos
Latest Reply
barnita99
New Contributor II
  • 0 kudos

Hi team, I have cleared my exam today. Unfortunately I have not received a single mail either to confirm my exam or to confirm test completion and result. @Cert-Team 

  • 0 kudos
1 More Replies
shiv_DB25
by New Contributor
  • 29 Views
  • 1 replies
  • 0 kudos

Getting error while installing applicationinsights

Library installation attempted on the driver node of cluster 0210-115502-3lo6gkwd and failed. Pip could not find a version that satisfies the requirement for the library. Please check your library version and dependencies. Error code: ERROR_NO_MATCHI...

  • 29 Views
  • 1 replies
  • 0 kudos
Latest Reply
shiv_DB25
New Contributor
  • 0 kudos

applicationinsights is library i am trying to install from cluster PyPi

  • 0 kudos
eranna_kc
by New Contributor
  • 110 Views
  • 6 replies
  • 1 kudos

Facing issue with Databricks Notification with Azure Python webhook

Hi All,     Could you be able to help to resolve the issue related to Azure Databricks Notification. Trigger is not happening whenever job fails or success to webhook. I have created webhook in Azure Automation account and created Python webhook and ...

eranna_kc_0-1738821477907.png
  • 110 Views
  • 6 replies
  • 1 kudos
Latest Reply
eranna_kc
New Contributor
  • 1 kudos

Please anybody can help on this issue?

  • 1 kudos
5 More Replies
Pranav_jha
by New Contributor III
  • 2654 Views
  • 16 replies
  • 4 kudos

Unable to Login - Account Verification Loop

I'm having trouble logging in to my Databricks account at databricks.com. Here's what happens:I enter my email address and password.I receive an account verification code via email.I enter the verification code on the login page.Instead of logging me...

  • 2654 Views
  • 16 replies
  • 4 kudos
Latest Reply
OliverBH
New Contributor II
  • 4 kudos

Same problem. Has anyone found a solution yet?

  • 4 kudos
15 More Replies
AnoopS1
by New Contributor
  • 47 Views
  • 2 replies
  • 0 kudos

Azure databricks connector issue while connecting Power BI to Databricks hosted on AWS

We have setup the integration between PowerBI and Databricks (hosted on AWS) using native databricks connector. However, we required Azure databricks connector to utilize the RBAC from unity catalog. We followed all the pre-requisite mentioned here ,...

  • 47 Views
  • 2 replies
  • 0 kudos
Latest Reply
AnoopS1
New Contributor
  • 0 kudos

OAuth is already enabled in databricks and all the pre-requisites are in place.

  • 0 kudos
1 More Replies
rsh48
by New Contributor
  • 57 Views
  • 1 replies
  • 0 kudos

unable to create DBX account : Unable to signup. Please try again, or sign in here...

Hi,I have been trying to create an account at databricks community edition but unable to do it for the past we weeks.Can someone from the databricks support team look into it? I am getting this since past few weeks. Unable to attach the HAR file. Do ...

rsh48_0-1739017357447.png
  • 57 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hi @rsh48, Could you please send a mail to community@databricks.com? and share your email details. Thanks.

  • 0 kudos
dbxlearner
by New Contributor
  • 71 Views
  • 1 replies
  • 0 kudos

Clarification on VACUUM LITE operation

Hi all, I wanted some insight and clarification on the VACUUM LITE command. VACUUM | Databricks on AWSSo I am aware that the VACUUM FULL command will deletes data files outside of the retention duration and all files in the table directory not refere...

  • 71 Views
  • 1 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Hello @dbxlearner, If you set your retention duration to 3 days for a VACUUM LITE operation, it means that the command will use the Delta transaction log to identify and remove files that are no longer referenced by any table versions within the last...

  • 0 kudos
pksilver
by New Contributor II
  • 221 Views
  • 10 replies
  • 4 kudos

Custom Tag Usage Reporting

Hi Team,Does anyone have a good SQL query that I can use for showing usage costs against custom tags for example on clusters. The Account Console usage report is good but I can only seem to query one custom tag at a time and ideally I want a dashboar...

  • 221 Views
  • 10 replies
  • 4 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 4 kudos

For reference:  

  • 4 kudos
9 More Replies
tomvogel01
by New Contributor II
  • 187 Views
  • 3 replies
  • 0 kudos

Dynamic Bloom Filters for Inner Joins

I have a question regarding combining the use of Bloom filters with Liquid Clustering to further reduce the data read during a join/merge on top of dynamic file pruning. Testing both combined worked extremely well together for point queries. However ...

  • 187 Views
  • 3 replies
  • 0 kudos
Latest Reply
merryray
New Contributor
  • 0 kudos

Bloom filters and dynamic file pruning should ideally work together, but it seems that in your case, they are interfering with each other, likely due to the way file pruning is being handled in the presence of Bloom filters. The most likely causes co...

  • 0 kudos
2 More Replies
parzival
by New Contributor II
  • 293 Views
  • 10 replies
  • 1 kudos

Unable to login to Community Edition

Facing the below issueWe were not able to find a Community Edition workspace with this email. Please login to accounts.cloud.databricks.com to find the non-community-edition workspaces you may have access to. For help, please see Community Edition Lo...

parzival_0-1738477941646.png
  • 293 Views
  • 10 replies
  • 1 kudos
Latest Reply
pakkufab1998
New Contributor II
  • 1 kudos

Hi All,Now neither I can sign up from my account not login. o response from them so good luck to everyone out there who's trying to learn this tool.

  • 1 kudos
9 More Replies
Daan
by New Contributor III
  • 71 Views
  • 1 replies
  • 0 kudos

Data difference between SQL warehouse and all-purpose compute

Hey everyone,Executing the following query on my sql warehouse does not return any data:select * from acc_bolt.eod.configurationhistory where netarea = '541454827900000139';However running the same query using an all-purpose compute does return the e...

  • 71 Views
  • 1 replies
  • 0 kudos
Latest Reply
Ayushi_Suthar
Databricks Employee
  • 0 kudos

Hi @Daan , Greetings! Can you please confirm which SQL warehouse you are using here? If you are using a serverless, then can you try to run the query with PRO/Classic warehouse?  Kind Regards, Ayushi

  • 0 kudos
anandreddy23
by New Contributor III
  • 5132 Views
  • 4 replies
  • 0 kudos

Pyspark cast error

Hi All,hive> create table UK ( a decimal(10,2)) ;hive> create table IN ( a decimal(10,5)) ;hive> create view T as select a from UK union all select a from IN ;above all statements executes successfully in Hive and return results when select statement...

  • 5132 Views
  • 4 replies
  • 0 kudos
Latest Reply
anandreddy23
New Contributor III
  • 0 kudos

Hi Nandini,Thanks for sharing the above solution. To be sure my understanding is correct, could you confirm below please ?hive> create table test.UK ( a decimal(10,2)) ;hive> create table test.IN ( a decimal(10,5)) ;hive> create view test.T as select...

  • 0 kudos
3 More Replies
tarunnagpal
by New Contributor II
  • 151 Views
  • 2 replies
  • 3 kudos

Snowflake to Databricks migration

We are working on a proposal for our existing customer to migrate approximately 500 tables and the associated business logic from Snowflake to Databricks. The business logic is currently implemented using stored procedures, which need to be converted...

  • 151 Views
  • 2 replies
  • 3 kudos
Latest Reply
eliana_oviedo
New Contributor II
  • 3 kudos

Hi @tarunnagpal !!Adding to what @MariuszK said,Using an LLM to accelerate the translation process is a great approach, but if the code is proprietary, it's best to use a closed model.Implementing a validation process is crucial to ensure that the tr...

  • 3 kudos
1 More Replies
fperry
by New Contributor III
  • 155 Views
  • 5 replies
  • 0 kudos

Issue with Multiple Stateful Operations in Databricks Structured Streaming

Hi everyone,I'm working with Databricks structured streaming and have encountered an issue with stateful operations. Below is my pseudo-code: df = df.withWatermark("timestamp", "1 second") df_header = df.withColumn("message_id", F.col("payload.id"))...

  • 155 Views
  • 5 replies
  • 0 kudos
Latest Reply
fperry
New Contributor III
  • 0 kudos

This should according to this blog post basically work, right? However, I'm getting the same errorMultiple Stateful Streaming Operators | Databricks BlogOr am I missing something? rate_df = spark.readStream.format("rate").option("rowsPerSecond", "1")...

  • 0 kudos
4 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors