cancel
Showing results for 
Search instead for 
Did you mean: 
Community Platform Discussions
Connect with fellow community members to discuss general topics related to the Databricks platform, industry trends, and best practices. Share experiences, ask questions, and foster collaboration within the community.
cancel
Showing results for 
Search instead for 
Did you mean: 

Forum Posts

unj1m
by New Contributor III
  • 789 Views
  • 3 replies
  • 0 kudos

Resolved! What version of Python is used for the 16.1 runtime

I'm trying to create a spark udf for a registered model and getting:Exception: Python versions in the Spark Connect client and server are different. To execute user-defined functions, client and server should have the same minor Python version. Pleas...

  • 789 Views
  • 3 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

No problem! 

  • 0 kudos
2 More Replies
gabrielsantana
by New Contributor II
  • 154 Views
  • 2 replies
  • 1 kudos

Delete non-community Databricks account

Hi everyone!I have mistakenly created a non-community account using my personal email address.I would like to delete it in order to create a new account using my business email.How should I proceed? I tried to find this option on the console, with no...

  • 154 Views
  • 2 replies
  • 1 kudos
Latest Reply
Advika
Databricks Employee
  • 1 kudos

Hello @gabrielsantana!Could you please try raising a ticket with the Databricks support team?

  • 1 kudos
1 More Replies
vijaykumar99535
by New Contributor III
  • 3060 Views
  • 1 replies
  • 1 kudos

How to overwrite the existing file using databricks cli

If i use databricks fs cp then it does not overwrite the existing file, it just skip copying the file. Any suggestion how to overwrite the file using databricks cli?

  • 3060 Views
  • 1 replies
  • 1 kudos
Latest Reply
Swap
New Contributor II
  • 1 kudos

You can use the --overwrite option to overwrite your file.https://docs.databricks.com/en/dev-tools/cli/fs-commands.html

  • 1 kudos
gf
by New Contributor II
  • 242 Views
  • 1 replies
  • 1 kudos

Resolved! The databricks jdbc driver has a memory leak

https://community.databricks.com/t5/community-platform-discussions/memory-leak/td-p/80756 My question is the same as above Unable to upload pictures, I had to dictateQuestion from ResultFileDownloadMonitor. M_requestList parametersBecause is ResultFi...

  • 242 Views
  • 1 replies
  • 1 kudos
Latest Reply
Walter_C
Databricks Employee
  • 1 kudos

Hello @gf thanks for your question, it seems that this has been reported with Simba, but no fix has been provided yet, as a temporary workaround, you can consider using reflection to periodically clean up the m_requestList by removing KV pairs whose ...

  • 1 kudos
hari-prasad
by Valued Contributor II
  • 282 Views
  • 3 replies
  • 0 kudos

Databricks Champions Sign-Up Page Failing or Throwing Error

Following link is throwing error when tried to Sign-Uphttps://advocates.databricks.com/users/sign_up?join-code=community 

  • 282 Views
  • 3 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

Let me check on this internally, I am not sure if this actually requires invitation. 

  • 0 kudos
2 More Replies
Sudheer2
by New Contributor III
  • 275 Views
  • 5 replies
  • 0 kudos

Issue with Adding New Members to Existing Groups During Migration in User group Service Principle

 Hi all,I have implemented a migration process to move groups from a source workspace to a target workspace using the following code. The code successfully migrates groups and their members to the target system, but I am facing an issue when it comes...

  • 275 Views
  • 5 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

I have provided response in https://community.databricks.com/t5/get-started-discussions/migrating-service-principals-from-non-unity-to-unity-enabled/m-p/103017#M4679 

  • 0 kudos
4 More Replies
Tanay
by New Contributor II
  • 235 Views
  • 1 replies
  • 1 kudos

Resolved! Why does a join on (df1.id == df2.id) result in duplicate columns while on="id" does not?

Why does a join with on (df1.id == df2.id) result in duplicate columns, but on="id" does not?I encountered an interesting behavior while performing a join on two Data frames. Here's the scenario: df1 = spark.createDataFrame([(1, "Alice"), (2, "Bob"),...

  • 235 Views
  • 1 replies
  • 1 kudos
Latest Reply
szymon_dybczak
Esteemed Contributor III
  • 1 kudos

Hi @Tanay , Your intuition is correct here. In Apache Spark, the difference in behavior between on (df1.id == df2.id) and on="id" in a join stems from how Spark resolves and handles column naming during the join operation.When you use the first synta...

  • 1 kudos
trimethylpurine
by New Contributor II
  • 3971 Views
  • 3 replies
  • 2 kudos

Gathering Data Off Of A PDF File

Hello everyone,I am developing an application that accepts pdf files and inserts the data into my database. The company in question that distributes this data to us only offers PDF files, which you can see attached below (I hid personal info for priv...

  • 3971 Views
  • 3 replies
  • 2 kudos
Latest Reply
NicholasGray
New Contributor II
  • 2 kudos

Thank you so much for the help.

  • 2 kudos
2 More Replies
Roig
by New Contributor II
  • 169 Views
  • 2 replies
  • 0 kudos

Create multiple dashboard subscription with filters

Hi Databricks community, We developed a dashboard that surfaces up several important KPIs for each project we have.In the top filter, we select the project name and the time frame and the dashboard will present the relevant KPIs and charts. I can eas...

  • 169 Views
  • 2 replies
  • 0 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 0 kudos

You can achieve this by setting up different schedules for each project and specifying the default filter values accordingly   Create the Dashboard: Ensure your dashboard is set up with the necessary filters, including the project filter.   Set Defau...

  • 0 kudos
1 More Replies
Nicolas_Izidoro
by New Contributor II
  • 261 Views
  • 5 replies
  • 1 kudos

Não estou conseguindo logar na minha conta Databricks communit

Galera não consigo logar na minha conta Databricks Communit fala que meu email não tem nada criado nele, mas eu tenho essa conta a um bom tempo já e nunca me ocorreu isso, já até tentei criar uma outra conta com esse mesmo email, mas não consigo cria...

  • 261 Views
  • 5 replies
  • 1 kudos
Latest Reply
Nicolas_Izidoro
New Contributor II
  • 1 kudos

infelizmente Não tenho nenhuma url

  • 1 kudos
4 More Replies
gluedhawkeye
by New Contributor II
  • 290 Views
  • 2 replies
  • 0 kudos

Calling the w.genie function throws a "API is not yet supported in the workspace" error. [0.39.0]

Hi everyone,I've been trying to call the databricks genie function, but even on the latest build, it throws the error stating: w.genie API is not yet supported in the workspace.Here is the output of the logs:> {> "content": "**REDACTED**"> }< {< "err...

  • 290 Views
  • 2 replies
  • 0 kudos
Latest Reply
filipniziol
Contributor III
  • 0 kudos

Hi @gluedhawkeye ,I tested this on my own and getting the same error:This is the same code as used here, but they have an info "This script implements an experimental chatbot that interacts with Databricks' Genie API, which is currently in Private Pr...

  • 0 kudos
1 More Replies
santiagortiiz
by New Contributor III
  • 2540 Views
  • 2 replies
  • 0 kudos

I was charged by a free trial

Hello databricks community, I took a databricks course to prepare for certification exam and requested a 14-days free trial on february 13 at 4:51 PM. So, February 27 at 4:51 pm must be the end of the free trial, but it ended 1 day before. Additional...

  • 2540 Views
  • 2 replies
  • 0 kudos
Latest Reply
ystoikov
New Contributor II
  • 0 kudos

Hello, @santiagortiiz ! It looks like you were charged for the AWS services, not for Databricks DBUs. On your screens, I see different amounts. 

  • 0 kudos
1 More Replies
Richie1602
by New Contributor II
  • 166 Views
  • 2 replies
  • 0 kudos

Issue with Percentage Calculation in Power BI Using Databricks as Source

Hi everyone,I've created a financial summary report in Power BI, and my source is Databricks. I have created a view for each financial metric name along with the calculations. All my amount fields are accurate, but when calculating percentages, I’m g...

  • 166 Views
  • 2 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

Hello Richie,In Databricks, you can use a combination of NULLIF and COALESCE functions to handle divide-by-zero scenarios effectively. Here's an example of how you can modify your percentage calculation:   SELECT MetricNo, MetricName, Amo...

  • 0 kudos
1 More Replies
sahil_s_jain
by New Contributor III
  • 374 Views
  • 4 replies
  • 0 kudos

GRPC call are not getting through on Databricks 15.4 LTS

Hi Team,I have updated spark version from 3.3.2 to 3.5.0 and switched to Databricks 15.4 LTS from 12.2 LTS so as to get Spark 3.5 version on the Databricks compute. We have moved from uploading libraries on DBFS to uploading libraries to Volumes as 1...

  • 374 Views
  • 4 replies
  • 0 kudos
Latest Reply
Walter_C
Databricks Employee
  • 0 kudos

And this was working before is it correct? When the init was hosted in DBFS

  • 0 kudos
3 More Replies
roshan_robert
by New Contributor II
  • 757 Views
  • 6 replies
  • 1 kudos

[JAVA_GATEWAY_EXITED] Java gateway process exited before sending its port number.

Hi Team,In a streamlit app (in databricks) while creating the spark session getting below error, this is happening when running the app via web link."[JAVA_GATEWAY_EXITED] Java gateway process exited before sending its port number"Below is the code u...

  • 757 Views
  • 6 replies
  • 1 kudos
Latest Reply
Alberto_Umana
Databricks Employee
  • 1 kudos

Per looking internally I see that Spark (Context) is not available in Apps The recommended way would be to use our available SDKs and connect to Clusters/DBSQL. No spark context is available- it’s meant to defer processing to other compute it can con...

  • 1 kudos
5 More Replies

Connect with Databricks Users in Your Area

Join a Regional User Group to connect with local Databricks users. Events will be happening in your city, and you won’t want to miss the chance to attend and share knowledge.

If there isn’t a group near you, start one and help create a community that brings people together.

Request a New Group
Top Kudoed Authors